Big Data

Big Data news, analysis, research, how-to, opinion, and video.

money cash dollars hands bids

Want to boost your salary? Learn Scala, Golang, or Python

Scala, Golang, and Python, along with big data tech like Apache Spark, reliably bolster your paycheck, according to salary-tracking site PayScale

big data group

8 reasons you'll do big data this year

To know what people are really doing with big data technology, you need to get dirty in the trenches. Here's what we've found

beautiful green farmland with blue sky and clouds

Redis plants the seeds for an open source ecosystem

Redis Modules help the caching and in-memory storage system work with new data structures and database behaviors

jw kafka partitions

Big data messaging with Kafka, Part 2

Learn how to use partitions, message offsets, and consumer groups to distribute load and scale your applications horizontally, handling up to millions of messages per day

open source keyboard

What does the future of the Apache Software Foundation hold?

Apache Software Foundation opens up about its community model and engaging private companies in open source

Big data messaging with Kafka, Part 1

Big data messaging with Kafka, Part 1

Built for realtime, Kafka scales horizontally and offers much higher throughput than some traditional messaging systems. Get started with installation, then build your first Kafka messaging system.

Chair race    187891029

Look out, Spark and Storm, here comes Apache Apex

A new open source streaming analytics solution derived from DataTorrent's RTS platform, Apex offers blazing speed and simplified programmability. Let's give it a spin

analytics big data stats statistics charts

Apache Beam wants to be uber-API for big data

New, useful Apache big data projects seem to arrive daily. Rather than relearn your way every time, what if you could go through a unified API?

Which big data programming language should I use?

Which freaking big data programming language should I use?

When it comes to wrangling data at scale, R, Python, Scala, and Java have you covered -- mostly

Hottest IT careers emerging today

The 6 hottest new jobs in IT

These leading-edge jobs could prove to be the most lucrative careers in tomorrow’s tech

eclair pastry dessert

EclairJS sweetens Spark for JavaScript coders

What? JavaScript instead of Scala or Python? The new EclairJS project bridges the language gap, especially if you already know Node.js

swissknife

Couchbase 4.0 review: The Swiss Army knife of NoSQL

Hybrid document-oriented, key-value database brings easy, ad hoc queries into the mix with a SQL-like query language

security graphic

Big data needs big security changes

Access control for big data analytics needs policy-based security that includes context as well as users and roles

flickr kdooley jw osjp apache phoenix

Open source Java projects: Apache Phoenix

If you have strong SQL programming skills and would like to be able to use them with a powerful NoSQL database, Phoenix could be the database you've been looking for!

mit probablistic patches code

Turns out machine learning is a champ at fixing buggy code

Here's yet another new application of machine learning: MIT has developed a system for fixing errors in bug-riddled code.

Big Data analytics machine learning

Why open source is the 'new normal' for big data

It's no secret that Hadoop and Apache Spark are two of the hottest technologies in big data today, but what's less commonly remarked upon is the fact that they're both open-source software.

Programming Predictions

9 predictions for the future of programming

Our coding crystal ball offers developers meaningful bets for the next five years -- but few guarantees given the rate of change for tech

spark

Why Spark 1.6 is a big deal for big data

Already the hottest thing in big data, Spark 1.6 turns up the heat. Here are the high points, including improved streaming and memory management

chalkboard with 1, 2, 3 written on it

16 for '16: What you must know about Hadoop and Spark right now

Amazingly, Hadoop has been redefined in the space of a year. Let's take a look at all the salient parts of this roiling ecosystem and what they mean

worry concern nervous fret

10 things to worry about in 2016

Yes, it's the poignant sequel to last week's reprieve: a jolly list of worries to keep you up at night this holiday season

Load More