[plug] Leap Second

[Leon Wright]

We had a few issues, nothing kernel related. Breakdown of what we saw (all
linux boxen)

3x Machines with Mono/Java both under high load
1x Machine with Mysql/Java both under high load
1x Machine with Java under high load

Fortunately UTC 00:00 being 08:00 locally meant no one noticed when I
rebooted all the boxes. Not my preferred solution, but I had other things
to do for the day. I did find a solution when all the people who'd finished
dealing with the issue and didn't have the luxury of being to take things
down:

http://blog.mozilla.org/it/2012/06/30/mysql-and-the-leap-second-high-cpu-and-the-fix/

Leon
--
DRM 'manages access' in the same way that jail 'manages freedom.'

# cat /dev/mem | strings | grep -i cats
Damn, my RAM is full of cats... MEOW!!


On Tue, Jul 3, 2012 at 7:35 AM, Alexander Hartner <alex at j2anywhere.com>wrote:

> I was looking for something more general. Surely this time it was cause by
> NTP, but who know what will happen next.
>
> Alex
>
> On 02/07/2012, at 21:14 , Paul Dean wrote:
>
> > hi Alex,
> >
> > Best spot is ntp.org, and maybe their mailing list.
> >
> > Lots of of "leap" second stuff there.
> >
> > Otherwise depending on your distro prefs, just install ntpd and point
> your boxen to the pool for the distro. ie *.debian.pool.ntp.org.
> >
> > Or you could hunt down a stratum 2/3 server use that. Prob best to email
> teh maintainer first.
> >
> > HTH.
> >
> > --
> >
> >
> > Thanks
> >
> > Paul Dean.
> >
> > "Life is not WHAT you make it, it's WHO you have in it..."
> >
> >
> > On Mon, 2 Jul 2012 18:55:16 +0800
> > Alexander Hartner <alex at j2anywhere.com> wrote:
> >
> >> Hi all,
> >>
> >> I am sure by now most of you would have come across the leap second
> issue from last Saturday or at least heard of it.
> >>
> >> http://asia.cnet.com/leap-second-bug-causes-site-outages-62217305.htm
> >> http://www.theregister.co.uk/2012/07/02/qantas_network_down/
> >> https://bugzilla.redhat.com/show_bug.cgi?id=479765
> >> https://access.redhat.com/knowledge/solutions/154793
> >>
> http://it.slashdot.org/story/12/07/01/1920217/leap-second-bug-causes-crashes
> >> https://access.redhat.com/knowledge/articles/15145
> >>
> http://artipc10.vub.ac.be/wordpress/2012/07/01/leap-second-causing-ksoftirqd-and-java-to-use-lots-of-cpu-time/
> >>
> >> While there are many websites talking about this now and include a fix,
> I haven't found any dating back to Friday advising us to prepare for this.
> No doubt the problem lies with the websites I visit :-)
> >>
> >> I was wondering if anybody can suggest / recommend a website which
> would have alerted us of this impending doom beforehand, so we can take
> pre-emtive action to address this.
> >>
> >> I am still a bit confused on what systems are exactly impacted. For
> example systems running oracle jdk 1.6.0_30 were not affected while other
> running open-jdk 1.6.0_20&24 were affected. Similarly linux running
> 3.1.10-1.9-default and 2.6.35.14-97.44.amzn1.x86_64 had issues while
> 3.1.6-gentoo did not. I suspect the problem with run-away java threads has
> been addressed in more recent versions of Java and is not related to the
> linux kernel version.
> >>
> >> Any thoughts on this?
> >> Best regards
> >> Alex
> >> _______________________________________________
> >> PLUG discussion list: plug at plug.org.au
> >> http://lists.plug.org.au/mailman/listinfo/plug
> >> Committee e-mail: committee at plug.org.au
> >> PLUG Membership: http://www.plug.org.au/membership
> >
> >
> > --
> >
> > Thanks
> >
> > Paul Dean.
> >
> > "Life is not WHAT you make it, it's WHO you have in it..."
> > _______________________________________________
> > PLUG discussion list: plug at plug.org.au
> > http://lists.plug.org.au/mailman/listinfo/plug
> > Committee e-mail: committee at plug.org.au
> > PLUG Membership: http://www.plug.org.au/membership
>
> _______________________________________________
> PLUG discussion list: plug at plug.org.au
> http://lists.plug.org.au/mailman/listinfo/plug
> Committee e-mail: committee at plug.org.au
> PLUG Membership: http://www.plug.org.au/membership
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.plug.org.au/pipermail/plug/attachments/20120703/a3b37721/attachment.html>