Big data skills bring big dough

If you can claim to be a data scientist and have the chops to back that up, you can pretty much write your own ticket even in this tough job market. A quick search of the popular job posting sites –Indeed.com, SimplyHired.com, or Dice.com shows a huge demand for data scientists or anyone who can demonstrate other “big data” skills.

The reason? Companies in all industries now understand that they need to make better sense of the massive data sets at their disposal — data sets that can include computer log files, social networking feeds, digital video or audio — you name it.

That’s led to a spike in demand for data scientists — professionals that understand math and statistics but also have a flare for “art” —  they understand how to display or visualize that raw information so its value can be understood. Petabytes of data are useless if no one can make sense of it.

Some headhunters have gotten creative, emailing reporters who cover the beat looking for recommendations. Here’s one recent email:

My client is one of the largest professional services firms in the world and they are looking for very senior data analytics experts who can apply his/her advanced analytics, predictive modeling, and data visualization skills to the fraud/dispute arena.  Exceptional compensation packages are available in the $ 300,000 to $ 500,000 range for the appropriate technical and leadership experience.

(Send me email if you want more info.)

Alice Hill, managing director for Dice.com, said her company just started tracking the category in December so it’s too early to have long-term comparisons of starting salaries or number of posts over time, but big data is nonetheless hot. “We can see shortages coming and when there are shortages, salaries go up,” she said.

“We’re starting to see terms like data scientist, natural language processing, showing up in many industries — it’ s not just mobile, not just high-tech companies,” said Hill. “The biggest thing about big data is it crosses every single industry. Wal-Mart was one of the first to start looking because of all the RFID chips and the tracking and supply chain management needs it has. “

She sees big data posts in financial services, in retail, in e-commerce.  According to recent Dice posts, Amazon is looking for a data scientist in seattle, Sears Holdings seeks a Hadoop administrator in Chicago; and Cision wants a “wicked smart” software engineer/Big Data in Chicago.


 

The VP of a big data-related vendor on the east coast just finished a sweep of career fairs at a number of universities in search of a research scientist — someone who can help develop algorithms for machine learning and for core Java developers — programmers to take those algorithms and implement them in scalable compute environments like Hadoop and Cassandra.

But he also sees a burgeoning need for a “data scientist” staff position. That person would head up all the data aggregation and the big data architecture.  People with the tech skills for that job are incredibly valuable, he said.

While he didn’t have hard numbers on data scientist salaries specifically, he did say that in the Washington D.C. area, a sales engineer that understands big data analytics and can implement a Hadoop architecture can command at least a 25 percent premium in salary over another highly technical sales engineer without those skills, he said.

As more companies gear up their big data efforts, it the imbalance between supply and demand of big data expertise will evaporate any time soon. Big data and the skills necessary to make sense of it will be on the agenda at GigaOM’s Structure: Data Conference in New York, next month.

Photo courtesy of Flickr user 401K

Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

  • Dissecting the data: 5 issues for our digital future
  • Connected world: the consumer technology revolution
  • Infrastructure Overview, Q2 2010



GigaOM