Big Data

Big Data | News, how-tos, features, reviews, and videos

analytics big data stats statistics charts

Apache Beam wants to be uber-API for big data

New, useful Apache big data projects seem to arrive daily. Rather than relearn your way every time, what if you could go through a unified API?

Which big data programming language should I use?

Which freaking big data programming language should I use?

When it comes to wrangling data at scale, R, Python, Scala, and Java have you covered -- mostly

analytics binary code network digital transformation

Big data analytics with Apache Spark

Set up and use Spark to analyze data contained in Hadoop, Splunk, files on a file system, local databases, and more.

Hottest IT careers emerging today

The 6 hottest new jobs in IT

These leading-edge jobs could prove to be the most lucrative careers in tomorrow’s tech

eclair pastry dessert

EclairJS sweetens Spark for JavaScript coders

What? JavaScript instead of Scala or Python? The new EclairJS project bridges the language gap, especially if you already know Node.js

swissknife

Couchbase 4.0 review: The Swiss Army knife of NoSQL

Hybrid document-oriented, key-value database brings easy, ad hoc queries into the mix with a SQL-like query language

security graphic

Big data needs big security changes

Access control for big data analytics needs policy-based security that includes context as well as users and roles

binary bridge

Bridge the SQL-NoSQL gap with Apache Phoenix

Apache Phoenix lets you use standard SQL queries in a NoSQL database, and it's optimized for HBase

mit probablistic patches code

Turns out machine learning is a champ at fixing buggy code

Here's yet another new application of machine learning: MIT has developed a system for fixing errors in bug-riddled code.

Big Data analytics machine learning

Why open source is the 'new normal' for big data

It's no secret that Hadoop and Apache Spark are two of the hottest technologies in big data today, but what's less commonly remarked upon is the fact that they're both open-source software.

Programming Predictions

9 predictions for the future of programming

Our coding crystal ball offers developers meaningful bets for the next five years -- but few guarantees given the rate of change for tech

spark

Why Spark 1.6 is a big deal for big data

Already the hottest thing in big data, Spark 1.6 turns up the heat. Here are the high points, including improved streaming and memory management

chalkboard with 1, 2, 3 written on it

16 for '16: What you must know about Hadoop and Spark right now

Amazingly, Hadoop has been redefined in the space of a year. Let's take a look at all the salient parts of this roiling ecosystem and what they mean

worry concern nervous fret

10 things to worry about in 2016

Yes, it's the poignant sequel to last week's reprieve: a jolly list of worries to keep you up at night this holiday season

big meal plates food hungry

Spark 1.6 feeds big data's hunger for memory

The forthcoming version of the popular data processing framework makes more efficient use of memory, addressing a common developers' complaint

University Research Projects

9 research projects that could transform the enterprise

From unstructured data mining to visual microphones, academic labs are bringing future breakthrough possibilities to light

frustration

5 things we hate about Spark

Spark has dethroned MapReduce and changed big data forever, but that rapid ascent has been accompanied by persistent frustrations

dev trends

9 developer trends you can bank on in 2016

From containers to NoSQL to Spark, here are the IT trends you can expect to persist next year.

Hadoop is slowly eating conventional analytics

The components of the Hadoop ecosystem won't overthrow Teredata or IBM Netezza any time soon, but ultimately, the commodity solution almost always wins.

An elephant holds an umbrella for a dog as they sit on a bench in the rain.

Hadoop, in trouble? Only in Gartner-land

A new poll of customers provides a brighter, more detailed picture of Hadoop adoption than Gartner's famously downbeat survey.

Load More