Posts Tagged ‘IronWorker’
Web Crawling at Scale with Nokogiri and IronWorker (Part 1)
This is a two-part post focusing on using Nokogiri and IronWorker to crawl websites and process web pages. Part two can be seen here. For other resources on web crawling, see our solutions page as well as this in-depth article on using IronWorker with PhantomJS. Web crawling is at the core of many web businesses.…
Read MoreIronWorker’s Most Requested Feature is Here: Max Concurrency
Overview Too many lemmings and you’ve got a problem. Being able to limit how many worker tasks can run at once has been one of the most requested features of IronWorker and it is available now! There are many reasons this feature is so important, here are a few of the more common use cases…
Read More.NET Just Got Some Iron Behind It
IronWorker now supports .NET so you can run .NET code at scale. Let your .NET workers process big data, send massive notifications, collect data from API’s, schedule tasks, etc. All in the cloud, no servers required. Here’s a quick Hello Worker example so you can see how easy it is to get started.
Read MoreServerless PhantomJS with IronWorker
PhantomJS is a headless WebKit with Javascript API. From it’s website, “It has fast and native support for various web standards: DOM handling, CSS selector, JSON, Canvas, and SVG.” In other words, PhantomJS is a great solution for things like web crawling/scraping, headless website testing, etc. The perfect match for IronWorker.
Read MorePowerful Email Infrastructure with IronWorker, ActionMailer, and SendGrid
Against most predictions, email has stood the test of time and remains one of the most common and effective forms of communication. This is particularly true in the world of web applications where the flow of information from app to user is constant. Ruby on Rails is one of the leading stack choices for building…
Read MoreThe New IronWorker Command Line Interface and .worker Files
We have created a shiny new command line interface (CLI) and a brand new way to define your workers to make uploading your worker code a lot easier and quicker. This should fit much better into the typical developer workflow so you can push to your git repo and upload your workers from the command…
Read MoreIronWorker Goes Hyperpolyglot – Adds Java, Node and Go Support
A hyperpolyglot is one who can speak six or more languages fluently. The term was coined by the linguist Richard Hudson in 2003 and derives from the word “polyglot”, meaning one who can speak multiple languages. Today marks a major step forward for IronWorker as we’ve opened the platform to a wide array of…
Read MoreHow to Reduce a 9 Hour Job into a 9 Minute Job
A common problem developers have is how to run through a large number of tasks in a short amount of time. For instance, sending out a nightly notification to all your users, calculating your user’s bills every month or updating their Facebook graph data. These types of things are very common and almost every application…
Read MoreRate Limiting Your Workers to Play Nicer with Other API’s
Overview Many third-party API’s have rate limits to ensure you don’t overuse or DoS them. Twitter for instance has the following rate limits: Unauthenticated calls are permitted 150 requests per hour. Unauthenticated calls are measured against the public-facing IP of the server or device making the request. OAuth calls are permitted 350 requests per…
Read MoreIronWorker and IronMQ now on AppFog
Today, we’re happy to announce that IronMQ and IronWorker are now included as supported add-ons for AppFog. We are very excited about this partnership because we share in the AppFog vision of creating fast, scalable and reliable applications in the cloud.
Read More