Spark Summit EU 2015: Spark DataFrames: Simple and Fast Analysis of Structure...Databricks
A technical overview of Spark’s DataFrame API. First, we’ll review the DataFrame API and show how to create DataFrames from a variety of data sources such as Hive, RDBMS databases, or structured file formats like Avro. We’ll then give example user programs that operate on DataFrames and point out common design patterns. The second half of the talk will focus on the technical implementation of DataFrames, such as the use of Spark SQL’s Catalyst optimizer to intelligently plan user programs, and the use of fast binary data structures in Spark’s core engine to substantially improve performance and memory use for common types of operations.
Spark Summit EU 2015: Spark DataFrames: Simple and Fast Analysis of Structure...Databricks
A technical overview of Spark’s DataFrame API. First, we’ll review the DataFrame API and show how to create DataFrames from a variety of data sources such as Hive, RDBMS databases, or structured file formats like Avro. We’ll then give example user programs that operate on DataFrames and point out common design patterns. The second half of the talk will focus on the technical implementation of DataFrames, such as the use of Spark SQL’s Catalyst optimizer to intelligently plan user programs, and the use of fast binary data structures in Spark’s core engine to substantially improve performance and memory use for common types of operations.
In this two part session, Devora Steinmetz explores the goals of Mishna study in elementary school; addresses how to select texts to teach to children; demonstrates presenting Mishna in a broader context; suggests strategies for teaching. Dr. Devora Steinmetz is the founder of Beit Rabban, a day school and center for educational research in New York City. She is the author of From Father to Son: Kinship, Conflict, and Continuity in Genesis and of articles on biblical and rabbinic texts. Dr. Steinmetz is currently Assistant Professor of Talmud and Rabbinics at the Jewish Theological Seminary.