Pharo DataFrame: Past, Present, and Future

•

0 likes•47 views

ESUG

Talk from IWST 2023

Software

Pharo DataFrame:
Past, Present, and Future
Larisa Safina, Oleksandr Zaitsev, Cyril Ferlicot-Delbecque,
Papa Ibrahima Sow
International Workshop on Smalltalk Technologies 2023, Lyon, France

Agenda
What is Data Frames and what they are good for
Evolution of Data Frames in Pharo
Data Frames outside of Pharo
2

Data Frames
Tabular structure
Columns with named headers
Columns/Rows index
Mixed data types in rows
Primitive data types
*The table is courtesy of Zaitsev et al (ESUG22)
3

Data Frames API
Data Import/Export
Grouping and Aggregation
Missing Data Handling
Statistical Operations
Time Series Analysis
Visualization
4
*The table is courtesy of Zaitsev et al (ESUG22)

Pharo DataFrame. Past
Started as a GSoC 2017 project (by Oleks)
Focus of the two followed-up GSoC
Contributions from external developers
5

Pharo DataFrame. Past
Problems:
- No stable maintenance
- Lack of functionality
- Low performance
- Incomplete coherence with Pharo collections
- Lack of detailed documentation
6

Pharo DataFrame. Present
Stable project with a permanent developer (Cyril)
Code optimization
- code quality
- speed and volume improvements
Adding new functionality
7

Awesome
Data Frames
8
Kyle Mitchell (jcmkk3) and
Uwe L. Korn (xhochy)
https://github.com/jcmkk3
/awesome-dataframes

Pharo DataFrame. Future
✨ Better performance ✨
Functionality Enhancements
Better synchronisation with PolyMath and pharo-ai
Big Data Support
Evaluation ❤
Toy Story 1995
10

Do you want to contribute?
https://github.com/PolyMathOrg/DataFrame
11

12
Student project → Mature project with engineers
Better performance
Functionality Enhancements
Evaluation

Similar to Pharo DataFrame: Past, Present, and Future

xldb2012_wed_0950_TimFrazier

Tim Frazier

Dalton Sergio Leonardo Eng Resume 20160803

Dalton Sergio Leonardo

Overview of Modern Graph Analysis Tools

Keiichiro Ono

OpenNebulaConf2017EU: FairShare Scheduling by Valentina Zaccolo, INDIGO

OpenNebula Project

This slides was used in ISO/IEC JTC1 SC36/WG8 meeting in December 1 2015. Also this is following thinking from “quick review for xAPI and IMS Caliper” (ISO/IEC JTC1 SC36/WG8 first webinar in Nov. 11, 2015). Through this slides I'm thinking two phases for mapping both data format. One is structural and syntactic mapping and the other is ontological mapping. Enjoy this trivial idea and please give my your valuable comments.

Thinking About Guideline for Data Interoperability - Design concept and workf...

Open Cyber University of Korea

Standards in Laboratory Automation (SiLA) is a vertical industry standard that promotes easy setup and interoperability between laboratory devices and management systems. To cope with the increasing market pressures and rapid changes in the technological landscape, the development of standards needs to become more agile. Furthermore, standards themselves must become increasingly modular to provide adequate flexibility. By analysing the SiLA 1.3 specifications and engaging a wide range of stakeholders in the life science industry, this Master’s thesis aims to present valuable insights and proposals regarding the improvement of the standard and its development. This improvement is achieved through a holistic approach that encompasses technical features, business motivations and processes, focusing on collaboration aspects. Using design science, an existing open-source solution has been extended to improve slow, non-transparent collaboration and engage more stakeholders in the standardisation process using a single common platform. DOI: 10.13140/RG.2.2.24278.65606 More information about SiLA: http://www.sila-standard.org/about-sila/

SiLA: Making the standard fit for the future and adapting an open-source coll...

Gáspár Incze

The AmeriFlux Network Data Management System

Integrated Carbon Observation System (ICOS)

MuseoTorino, first italian project using a GraphDB, RDFa, Linked Open Data

21Style

Giancarlo Ronci eng

Giancarlo Ronci

Andy Petrella_Med@Scale by Data Fellas: Scalable and Interoperable Genomics d...

Dataconomy Media

Data science requires so many skills, people and time before the results can be accessed. Moreover, these results cannot be static anymore. And finally, the Big Data comes to the plate and the whole tool chain needs to change. In this talk Data Fellas introduces Shar3, a tool kit aiming to bridged the gaps to build a interactive distributed data processing pipeline, or loop! Then the talk covers genomics nowadays problems including data types, processing, discovery by introducing the GA4GH initiative and its implementation using Shar3.

Data Enthusiasts London: Scalable and Interoperable data services. Applied to...

Andy Petrella

Productive Development with APEX

Simon Boorsma

ION Durban - What's Happening at the IETF?

Deploy360 Programme (Internet Society)

2015 Data Science Summit @ dato Review

Hang Li

System Architecture_BPM TIBCO_Network Inventory

Ela Pamieta

FACE-IT is an effort to develop a new IT infrastructure to accelerate existing disciplinary research and enable information transfer among traditionally separate fields. At present, finding data and processing it into usable form can dominate research efforts. By providing ready access to not only data but also the software tools used to process it for specific uses (e.g., climate impact and economic model inputs), FACE-IT allows researchers to concentrate their efforts on analysis. Lowering barriers to data access allows researchers to stretch in new directions and allows researchers to learn and respond to the needs of other fields. FACE-IT builds on the Globus Galaxies platform, which has been developed over the past several years at the University of Chicago. FACE-IT also benefit from substantial software development undertaken by the communities who have developed most of the domain-specific tools required to populate FACE-IT with useful capabilities. The FACE-IT Galaxy manages earth system datatypes (as NetCDF), new tool parameters (dates, map, opendap), aggregated datatypes (RAFT), service providers and cool map visualizers.

How to expand the Galaxy from genes to Earth in six simple steps (and live sm...

Raffaele Montella

Financial companies need Java EE to power its business today. Rakuten Card, one of the largest credit card companies in Japan, adopted Java EE 7 for its credit card core systems rearchitecture, from one of the oldest COBOL based mainframe in Japan. Additionally, we chose Apache Spark for super rapid batch execution platform. We completed this big core system migration project successfully. You can learn why we choose Java EE, and Apache Spark for super rapid batch execution, and our experiences and lessons we learned. How to start such a big project? Why we choose it, how we ported, how use Apache Spark for performance improvements, and launched with? We’ll answer these questions and any that you may have.

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...

Hirofumi Iwasaki

Network Automation e-Academy

CSUC - Consorci de Serveis Universitaris de Catalunya

Apache Flink: Past, Present and Future

Gyula Fóra

Flex Olap Components

tyler frieling

Similar to Pharo DataFrame: Past, Present, and Future (20)

xldb2012_wed_0950_TimFrazier

Dalton Sergio Leonardo Eng Resume 20160803

Overview of Modern Graph Analysis Tools

OpenNebulaConf2017EU: FairShare Scheduling by Valentina Zaccolo, INDIGO

Thinking About Guideline for Data Interoperability - Design concept and workf...

SiLA: Making the standard fit for the future and adapting an open-source coll...

The AmeriFlux Network Data Management System

MuseoTorino, first italian project using a GraphDB, RDFa, Linked Open Data

Giancarlo Ronci eng

Andy Petrella_Med@Scale by Data Fellas: Scalable and Interoperable Genomics d...

Data Enthusiasts London: Scalable and Interoperable data services. Applied to...

Productive Development with APEX

ION Durban - What's Happening at the IETF?

2015 Data Science Summit @ dato Review

System Architecture_BPM TIBCO_Network Inventory

How to expand the Galaxy from genes to Earth in six simple steps (and live sm...

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...

Network Automation e-Academy

Apache Flink: Past, Present and Future

Flex Olap Components

Recently uploaded

WSO2CON 2024 - Architecting AI in the Enterprise: APIs and Applications

WSO2

WSO2CON 2024 - Designing Event-Driven Enterprises: Stories of Transformation

WSO2

WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...

WSO2

WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...

WSO2

WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...

WSO2

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...

SelfMade bd

%in Soweto+277-882-255-28 abortion pills for sale in soweto

masabamasaba

WSO2CON2024 - It's time to go Platformless

WSO2

WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source

WSO2

WSO2Con2024 - GitOps in Action: Navigating Application Deployment in the Plat...

WSO2

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal.

%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...

masabamasaba

WSO2CON 2024 - Unlocking the Identity: Embracing CIAM 2.0 for a Competitive A...

WSO2

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...

WSO2

ADR, or Architecture Decision Record, is a valuable tool in software development for several reasons. It provides a centralized location for documenting and tracking architectural decisions, aiding both current and future team members. ADRs enhance communication among team members by documenting the rationale behind architectural decisions, especially beneficial during onboarding of new team members or when revisiting decisions. They serve as a knowledge base, enabling teams to learn from past decisions and refine their decision-making process. Additionally, ADRs contribute to transparency by helping stakeholders understand the reasons behind specific architectural choices. As with any other tool or process, introducing them into an organization can face several obstacles, and overcoming these challenges is crucial for successful implementation. In this talk I go through some common problems and our way of solving them.

Architecture decision records - How not to get lost in the past

Papp Krisztián

WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...

WSO2

WSO2CON 2024 Slides - Unlocking Value with AI

WSO2

WSO2CON 2024 - Building a Digital Government in Uganda

WSO2

WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!

WSO2

Recently uploaded (20)