<div dir="ltr">Apologies, you may have misunderstood. I have nanoseconds via network captures (in pcap-ng etc) but the ELK stack AFAIK only copes with milliseconds which makes it problematic. ELK looks lovely, but without nanosecond support it doesn't work for many people with similar needs to myself. Though I may be missing something and it has nanosecond support hidden in there somewhere which is what I was asking about. <div>
<br></div><div><div>Kind regards,</div><div><br></div><div>--Matt.</div><div><br></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 10 August 2014 14:19, Lux, Jim (337C) <span dir="ltr"><<a href="mailto:james.p.lux@jpl.nasa.gov" target="_blank">james.p.lux@jpl.nasa.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-serif">
<div>
<div>
<div>Nanoseconds?</div>
<div>You need something like a GPS (run of the mill is good to 10-50 ns) or IEEE-1588 timing distribution (Precision Time Protocol)</div>
<div><br>
</div>
<div>If you have accurate 1pps to appropriate hardware on your nodes, then getting (much better) than sub-microsecond timing is more a matter of software than the hardware.</div>
<div><br>
</div>
<div>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)">James Lux, P.E.<u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)">Task Manager, FINDER – Finding Individuals for Disaster and Emergency Response<u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)">Co-Principal Investigator, SCaN Testbed (</span><i>née</i><span style="color:rgb(31,73,125)"> CoNNeCT) Project<u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)">Jet Propulsion Laboratory<u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)">4800 Oak Grove Drive, MS 161-213<u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)">Pasadena CA 91109<u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)"><a href="tel:%2B1%28818%29354-2075" value="+18183542075" target="_blank">+1(818)354-2075</a><u></u><u></u></span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><span style="color:rgb(31,73,125)"><a href="tel:%2B1%28818%29395-2714" value="+18183952714" target="_blank">+1(818)395-2714</a> (cell)</span></p>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt"><u></u> <u></u></p>
</div>
</div>
</div>
<div><br>
</div>
<span>
<div style="font-family:Calibri;font-size:11pt;text-align:left;color:black;BORDER-BOTTOM:medium none;BORDER-LEFT:medium none;PADDING-BOTTOM:0in;PADDING-LEFT:0in;PADDING-RIGHT:0in;BORDER-TOP:#b5c4df 1pt solid;BORDER-RIGHT:medium none;PADDING-TOP:3pt">
<span style="font-weight:bold">From: </span>Matt Hurd <<a href="mailto:matthurd@acm.org" target="_blank">matthurd@acm.org</a>><br>
<span style="font-weight:bold">Date: </span>Saturday, August 9, 2014 at 5:16 PM<br>
<span style="font-weight:bold">To: </span>Walid <<a href="mailto:walid.shaari@gmail.com" target="_blank">walid.shaari@gmail.com</a>><br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:beowulf@beowulf.org" target="_blank">beowulf@beowulf.org</a>" <<a href="mailto:beowulf@beowulf.org" target="_blank">beowulf@beowulf.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [Beowulf] ELK query "Elasticsearch, logstash and Kibana"<br>
</div><div><div class="h5">
<div><br>
</div>
<div>
<div>
<div dir="ltr">Can it do better than millisecond time stamps yet? My network stuff needs nanoseconds or better...
<div><br>
</div>
<div>--Matt.</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On 7 August 2014 12:48, Walid <span dir="ltr"><<a href="mailto:walid.shaari@gmail.com" target="_blank">walid.shaari@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><span style="font-family:arial,sans-serif;font-size:13px">Hi,</span>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">I am interested to see if any one is already using ELK for HPC related logs. i would like to know more about what metrics, information, reports they are generating and logstash patterns, filters, any
groks used. I have just started working on this starting with the configuration management side of systems, however i see huge potential for people who can not afford to have splunk, I am thinking scheduler, interconnect, GPFS, provisioning, system logs, job
tractability, metrics from accounting file, profiling, better failure management and visualisation. </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">kind regards</div>
<span><font color="#888888">
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">Walid</div>
</font></span></div>
<br>
_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org" target="_blank">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="http://www.beowulf.org/mailman/listinfo/beowulf" target="_blank">
http://www.beowulf.org/mailman/listinfo/beowulf</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div></div></span>
</div>
<br>_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="http://www.beowulf.org/mailman/listinfo/beowulf" target="_blank">http://www.beowulf.org/mailman/listinfo/beowulf</a><br>
<br></blockquote></div><br></div>