Free

NYJavaSIG - Polyglot GraalVM -and- Spark Secrets for Data Engineers

Event Information

Share this event

Date and Time

Location

Location

Credit Suisse - main building

11 Madison Ave

Colello Auditorium - Room 2B

New York, NY

View Map

Event description

Description

Polyglot Java EE on the GraalVM - Ryan Cuprak

The new GraalVM supports multiple language including JavaScript, Python, Ruby, R, C++ as well as Java and other JVM languages. This opens up interesting possibilities for polygot enterprise applications. Now you can use a Node library in a Java application or call an R statistical function from an EJB. Previously, this type of integration was extremely challenging. This session will provide recipes to get up and running along with best practices and some cool demos.

Data Pipelines with Apache Spark: Architectural Secrets for Data Engineers - Fabiane Nardone

Solving data science problems typically means building data pipelines that will execute several aggregating operations on one or more datasources. This session discusses architectural secrets for accelerating the construction of data pipelines in Apache Spark at scale. It shows you how to eliminate the gap between experimentation and production, how to solve security access issues, and how to scale the pipeline execution. The presentation also demonstrates how to use a plugin-based system with Spark SQL to increase productivity and leverage your legacy Java code, how to design data lakes to be used with data pipelines, how to keep the pipelines’ execution history to detect anomalies, and several other techniques.



Share with friends

Date and Time

Location

Credit Suisse - main building

11 Madison Ave

Colello Auditorium - Room 2B

New York, NY

View Map

Save This Event

Event Saved