E is for Event: A Fresh Take on ETL

ETL

As a follow up to my previous post, The Workloads of the Internet of Things, I wanted to walk through a real world example that fully captures the principles of event-driven computing put forth.

Let’s set the stage first… imagine we operate a windmill farm and want to continually track optimal weather conditions to maximize energy output. What basic steps need to be taken?

  1. Sensors capture surrounding weather conditions
  2. Captured data is delivered to a backend service
  3. The service calculates the expected power generation
  4. Calculated data is delivered to an analytics system
  5. Data is presented in a variety of charts and maps

This process flow sounds similar to the common Extract, Transform, Load (ETL) pattern, however the distinction to make here is that data is pushed from the source to the backend service instead of pulled. This means we need to update our pipeline to be more reactive.

Continue reading “E is for Event: A Fresh Take on ETL”

The Workloads of the Internet of Things

I must say my favorite part about researching the Internet of Things has to be the mind blowing stats. Just a couple from the arsenal… we already have more connected devices on the planet than humans, and every two days we create more data than all of human history up to 2003. The predictions are wild too… Intel predicts that there will be 200 billion connected devices by 2020, and Cisco predicts the market size to reach $14.4 Trillion by 2022. It’s hard to really wrap your head around numbers like that, but there was one that really jumped out at me – IDC predicts that Internet of Things workloads will increase approximately 750% by 2019. Why that really matters: how on earth are we going to handle that level of scale?

Continue reading “The Workloads of the Internet of Things”

Beyond The Hype: The Internet of Things

Internet-of-Things-On-Demand-WebinarThe buzz surrounding the Internet of Things shows no signs of subsiding. At the same time, its potential has grown expediently. This appears to be one case where what is delivered will dwarf the hype. But, what does this mean for you and me?

Though the media and analysts talk about enabling Internet data in previously unconnected devices, many people have trouble visualizing exactly what that means. Continue reading “Beyond The Hype: The Internet of Things”