Big Data

Big Data | News, how-tos, features, reviews, and videos

Which big data programming language should I use?

Which freaking big data programming language should I use?

When it comes to wrangling data at scale, R, Python, Scala, and Java have you covered -- mostly

Hottest IT careers emerging today

The 6 hottest new jobs in IT

These leading-edge jobs could prove to be the most lucrative careers in tomorrow’s tech

eclair pastry dessert

EclairJS sweetens Spark for JavaScript coders

What? JavaScript instead of Scala or Python? The new EclairJS project bridges the language gap, especially if you already know Node.js

swissknife

Couchbase 4.0 review: The Swiss Army knife of NoSQL

Hybrid document-oriented, key-value database brings easy, ad hoc queries into the mix with a SQL-like query language

security graphic

Big data needs big security changes

Access control for big data analytics needs policy-based security that includes context as well as users and roles

Open source Java projects: Apache Phoenix

If you have strong SQL programming skills and would like to be able to use them with a powerful NoSQL database, Phoenix could be the database you've been looking for!

mit probablistic patches code

Turns out machine learning is a champ at fixing buggy code

Here's yet another new application of machine learning: MIT has developed a system for fixing errors in bug-riddled code.

Big Data analytics machine learning

Why open source is the 'new normal' for big data

It's no secret that Hadoop and Apache Spark are two of the hottest technologies in big data today, but what's less commonly remarked upon is the fact that they're both open-source software.

Programming Predictions

9 predictions for the future of programming

Our coding crystal ball offers developers meaningful bets for the next five years -- but few guarantees given the rate of change for tech

spark

Why Spark 1.6 is a big deal for big data

Already the hottest thing in big data, Spark 1.6 turns up the heat. Here are the high points, including improved streaming and memory management

chalkboard with 1, 2, 3 written on it

16 for '16: What you must know about Hadoop and Spark right now

Amazingly, Hadoop has been redefined in the space of a year. Let's take a look at all the salient parts of this roiling ecosystem and what they mean

worry concern nervous fret

10 things to worry about in 2016

Yes, it's the poignant sequel to last week's reprieve: a jolly list of worries to keep you up at night this holiday season

big meal plates food hungry

Spark 1.6 feeds big data's hunger for memory

The forthcoming version of the popular data processing framework makes more efficient use of memory, addressing a common developers' complaint

University Research Projects

9 research projects that could transform the enterprise

From unstructured data mining to visual microphones, academic labs are bringing future breakthrough possibilities to light

frustration

5 things we hate about Spark

Spark has dethroned MapReduce and changed big data forever, but that rapid ascent has been accompanied by persistent frustrations

dev trends

9 developer trends you can bank on in 2016

From containers to NoSQL to Spark, here are the IT trends you can expect to persist next year.

Hadoop is slowly eating conventional analytics

The components of the Hadoop ecosystem won't overthrow Teredata or IBM Netezza any time soon, but ultimately, the commodity solution almost always wins.

An elephant holds an umbrella for a dog as they sit on a bench in the rain.

Hadoop, in trouble? Only in Gartner-land

A new poll of customers provides a brighter, more detailed picture of Hadoop adoption than Gartner's famously downbeat survey.

The big greenfield cannabis cloud

The marijuana business is making the leap from paper ledgers to the cloud and big data analytics, offering a provocative example for us all.

Open source Java projects: Apache Spark

Set up and use Spark to analyze data contained in Hadoop, Splunk, files on a file system, local databases, and more.

Load More