Screen Shot 2014-07-13 at 19.20.16

Spark!

More than 80 people showed up at our last meetup focused on Spark. Because there are more and more signs that Spark will become the successor to Hadoop MapReduce we invited some people who are already using Spark in production.

Andy gave an introduction to functional progamming and Scala in just 45 minutes, which is  definitely not enough for passing all details. His slides can be found here

Excellent meetup. The Scala introduction was so quick that it blew my mind but gave me enough information to follow the rest

(Eric Darchis)

We had Toni Verbeiren who gave an introduction to Spark and demonstrated Spark from the command line. Follow the links to his slides and visualization code.

Very interesting mix of Scala, Spark and Use Case

(Peter Vandenabeele)

Gerard Maas showed us how Spark is used in production at Virdata.com. With a cool demo of their platform in the end. His slides are availabele here: Spark-at-Virdata

It was Sparkling! (Radek O)

I am always amazed by the quality of the BigData.be and ScalaBe presentations. Big up to all of you ! (Frederic)

The presentations were recorded by Parleys.com and to be published in a “bigdata.be” channel. We’ll let you know when they become available over there.

Thanks to Ordina for the location and for providing food and drinks.

See you next time, we are always looking for venues and presenters.

 

SONY DSC

Data science and R meetup

As announced on our meetup page, we had @JaredLander over from New York for a project at BigBoards.  So we rose to the occasion and had him talk about Backends for Big Data in R. This comment from the meetup page, says it all!

Nice fast-paced presentation with style from Jared
Marcel Dumont

To complement this “gentle introduction to R” ;-), our second presentation was given by DataCamp. They introduced us to what DataCamp stands for, how their platform is architected and how teachers write courses (completely in R!). Again, your feedback says more than a thousand words …

This presentation impressed me the most. How a couple of students from the KULeuven can start-up their own company and be successful in filling the gap of training services in R
Jean-Jacques DE CLERCQ

(Hey guys @datacamp, if you are reading this from over there in LA at the use R! conference, can we share your slides here?)

What did you learn? What do you think about this meetup?

IMG_1973

23RD MEETUP – DATA SCIENCE/ELASTICSEARCH/ELECTIONS

On May 27th we had our 23rd meetup in Ghent kindly hosted by iMinds. We had a healthy mix of technical and business items.

Following presentations were given:

  1. Introduction to the Brussels Data Science Meetup by Philippe Van Impe (30 min)

Philippe gave an introduction to this Meetup, the projects they are working (with possible link to big data) and their link to the non-profit datakind organization (“data for good”)

His presentation can be found here.

2.  Introduction to ElasticSearch by Eric Rodriguez (60 min)

In just less than one hour Eric gave an introduction to all features of ElasticSearch.  During the presentation Toon Vanaght showed how ES is used at data.be.

His presentation can be found here and you are also invited to checkout the Belgian ElasticSearch Meetup group.

3.  Election Bingo by Stijn Beauprez (30 min)

The vk14-bingo.be application can be used for making up your mind for voting on sunday, it gives you insight into the topics our political parties are talking about.

Stijn demo-ed the application and explained which technologies were used to implement this application.

His presentation can be found here.

4.  De Verkiezingen by Philippe Kerremans (10 min)

Deverkiezingen.be website is another application of using social media to get insight into the mother of all elections. Philippe explained how they used ElasticSearch and D3.js among other technologies.

His presentation can be downloaded here: BigDataMeetupDeverkiezingen

Many thanks to iMinds for hosting the location and DataCrunchers for providing drinks.

In the mean time we now have more than 700 members!

22nd meetup

22nd meetup – Cloudera on HBase and Scoop

It has been quite a while since we actually posted something on our website. Wow!!! Time really flies.

On April 4th 2014, we had our 22nd meetup already. Klaas Bosteels was able to attract 2 prominent speakers from Cloudera who were touring Europe and presenting at the 2014 Hadoop Summit in Amsterdam.

  1. Jon Hsieh (Software Engineer @ Cloudera and HBase Committer/PMC Member) talked about Apache HBase: Now and the futureApache HBase is a distributed non-relational database that provides low-latency random read write access to massive quantities of data. This talk will be broken up into two parts. First I’ll talk about how in the past few years, HBase has been deployed in production at companies like Facebook, Pinterest, Groupon, and eBay and about the vibrant community of contributors from around the world include folks at Cloudera, Salesforce.com, Intel, HortonWorks, Yahoo!, and XiaoMi. Second I’ll talk about the features in the newest release 0.96.x and in the upcoming 0.98.x release.
  2. Kate Ting (Technical Account Manager @ Cloudera and Sqoop Committer/PMC Member, co-author of the Apache Sqoop Cookbook) presented Apache Sqoop: Unlock HadoopUnlocking data stored in an organization’s RDBMS and transferring it to Apache Hadoop is a major concern in the big data industry. Apache Sqoop enables users with information stored in existing SQL tables to use new analytic tools like Apache HBase and Apache Hive. This talk will go over how to deploy and apply Sqoop in your environment as well as transferring data from MySQL, Oracle, PostgreSQL, SQL Server, Netezza, Teradata, and other relational systems. In addition, we’ll show you how to keep table data and Hadoop in sync by importing data incrementally as well as how to customize transferred data by calling various database functions.

And of course, Accenture was so kind to host us at their gorgeous venue in Brussels with that spectacular view! They presented their Big Data Challenge where 4 teams of about 5 consultants deep dived into big data and data science to solve some practical cases. You can get in touch with their consultants to know more.

At least the elaborated example on real-time predicting the delays of  public transport was really interesting. It made my hands itch to start a new BigData.be project!

See you next time!

16th meetup — Scaling Big Data Mining Infrastructure: The Twitter Experience

It’s a bit late notice unfortunately, but we’ll be doing another meetup on July 16th in Ghent, featuring a very promising talk by renowned data geek Jimmy Lin about Twitter’s big data mining infrastructure. Space is limited, so you should head to our corresponding meetup page straight away to reserve your spot.

Talk abstract

The analytics platform at Twitter has experienced tremendous growth over the past few years in terms of size, complexity, number of users, and variety of use cases. This talk will discuss the evolution of the Twitter infrastructure and the development of capabilities for data mining on “big data”. We’ll share experiences as a case study, but make recommendations for best practices and point out opportunities for future work.

About the speaker

Jimmy Lin is an associate professor in the iSchool at the University of Maryland, with appointments in the Institute for Advanced Computer Studies (UMIACS) and the Department of Computer Science. He works on “big data”, with a particular focus on large-scale distributed algorithms for text processing. His research lies at the intersection of natural language processing (NLP) and information retrieval (IR). Recently, Jimmy spent an extended sabbatical (from 2010 to 2012) at Twitter working on large-scale data analytics. Previously, he has also done work for Cloudera, the enterprise Hadoop company.

9th meetup – schedule complete

Good news everyone!

The schedule for our 9th meetup is complete, we will have three talks from different areas of the big-data universe:

We hope you like this schedule, as much, as we do and see plenty of you!

-BigData.be

9th meetup – call for participation

Hello all,

The friendly folks of NGDATA in Gent will host our 9th meetup. Thanks for that already!

Next to a location, we are always looking for interesting things to discuss during the meetup. Have you read something interesting in the bigdata/nosql space lately? Are you implementing something amazing right now? Do you have a problem, that you want to discuss? Let us know!

Looking forward to hearing from you all!

-BigData.be

Belgian community about big data and NoSQL