Learning from Facebook’s Outage

Making the most of Facebook's outage Thanks to Kārlis Dambrāns for providing the base image. CC BY 2.0

Facebook’s suffered three outages this month; two of which occurred within the span of a week. Ouch. If you know any folks on the FB ops team, now’s a good time to buy ‘em a beer.

Whenever a blip like this appears, it’s a good time for all of us to look at our own infrastructure. Are you prepared?

First things first, what caused the FB outage? Facebook links the most recent to an issue with the Graph API. The September 22nd issue was due to a hiccup with the Realtime Update service. It’s the sort of thing that could happen at any company.

Despite the impact, it’s good to see Facebook has a sense of humor about the downtime. Their response to the update service issue reads, “will post an update here as soon as we know more.” I love the sly wink.

Continue reading “Learning from Facebook’s Outage”

2015 Container Summit notes and learnings, part 2

Containers, VMs, & Infrastructure Part 2

Yesterday we shipped part 1 of our Container Summit notes. Today is a continuation! We’ll share a few of the other talks we enjoyed.

In this post you’ll find stories from Wall Street veterans, open source giants, and nimble challengers.

Continue reading “2015 Container Summit notes and learnings, part 2”

2015 Container Summit notes and learnings, Part 1

Container Summit 2015

A day ago I joined 700+ folks at the Palace Hotel in San Francisco to attend the 2015 Container Summit. Container’s are young, but one thing this event made clear is the forebears have been around quite a while.

A favorite part of the summit was hearing war stories. That is, how containers are called on to get things done in the real world. There were plenty of looks to the past and the future, as well.

I learned quite a bit! What follows is part one of my notes and learnings from Container Summit.
Continue reading “2015 Container Summit notes and learnings, Part 1”

At @SCALE 2015

Yesterday I swung down to San Jose to listen to Facebook, Box, Google, Twitter, Microsoft and other leaders speak at the overflowing San Jose Convention Center. The @SCALE 2015 conference was a great opportunity to hear Tech titans speak.

It was a scene of hungry minds and egalitarian ideals. If there’s a core takeaway from @SCALE, it’s this: we’re all in it together. Why not share?

Thanks to JD Hancock for the base image CC BY 2.0 Thanks to JD Hancock for the base image CC BY 2.0

Continue reading “At @SCALE 2015”

When and Why for Microservices

Thanks to Thomas Leuthard for the base image CC BY 2.0 Thanks to Thomas Leuthard for the base image CC BY 2.0

Microservices are difficult. Don’t believe me? Let’s read a quote from Chris Richardson, the founder of CloudFoundry:

When developing the first version of an application, you often do not have the problems that [the microservices] approach solves. Moreover, using an elaborate, distributed architecture will slow down development. This can be a major problem for startups whose biggest challenge is often how to rapidly evolve the business model and accompanying application.

Oh. Microservices are difficult. So, why is everyone so excited about them? To answer, I’m going to do something controversial: link to a TED talk. Continue reading “When and Why for Microservices”

Legible + efficient SQL with CTEs

Thanks to Jonny Hughes for the image! Thanks to Jonny Hughes for the base image!

Howdy! I’m Paul, and I’m one of the newer faces here at iron.io. My plan is to blog, champion local meetups, and empower developers. That last one is a whiz-bang business term for “help folks learn how to do dead-simple job processing.”

Today, I’ll blog about an old love of mine, Common Table Expressions (CTEs). It’s a tool anyone who’s even sneezed near a SQL statement ought to know about. Just a select few SQL sorcerers seem to be aware of their existence. Let’s change that! Continue reading “Legible + efficient SQL with CTEs”

Project Thor Will Deliver First True Hybrid IronWorker Solution

Today, Iron.io announced Project Thor, which is developing the world’s first hybrid job processing system. This is unlike anything we’ve done to date. Unlike previous IronWorker technology, Project Thor is architected to deliver the power of Iron.io to any server in the world in minutes.

With Project Thor, the Iron.io IronWorker Docker container is deployed on a company’s own servers, which then communicates with the Iron.io API. This brings the power of Iron.io’s event-driven computing service to the Enterprise in just a few easy steps. Project Thor seamlessly integrates with existing solutions for container deployment, such as OpenShift by Red Hat, Cloud Foundry, OpenStack and Kubernetes.

Continue reading “Project Thor Will Deliver First True Hybrid IronWorker Solution”

The Ephemeral Life of Dockerized Microservices

When using the word ‘ephemeral’, it’s hard not to think of Snapchat these days, however the concept applies to the on demand computing pattern we promote here at Iron.io with our task processing service IronWorker. At a glance, each Docker container in which a task runs is only alive for the duration of the process itself, providing a highly effective environment for powering applications that follow the microservices architectural style.
Continue reading “The Ephemeral Life of Dockerized Microservices”

Iron.io Launches IronWorker within the Azure Marketplace

Iron.io is pleased to announce it is offering its IronWorker platform as an Application Service within the Azure Marketplace, providing a key infrastructure component that gives developers immediate access to highly scalable event-driven computing services.

Every application in the cloud needs to process workloads on a continuous basis, at scale, on a schedule, or in the background. IronWorker is a modern application development platform for processing at a task level by isolating code packages and dependencies in a containerized compute environment managed by Iron.io.

Continue reading “Iron.io Launches IronWorker within the Azure Marketplace”

Docker in Production — What We’ve Learned Launching Over 300 Million Containers

Docker in Production at Iron.io

Earlier this year, we made a decision to run every task on IronWorker inside its own Docker container. Since then, we’ve run over 300,000,000 programs inside of their own private Docker containers on cloud infrastructure.

Now that we’ve been in production for several months, we wanted to take the opportunity to share with the community some of the challenges we faced in running a Docker-based infrastructure, how we overcame them, and why it was worth it.

Continue reading “Docker in Production — What We’ve Learned Launching Over 300 Million Containers”