FluidDB NYC Python presentation

•

1 like•655 views

FluidDB is a shared, global database that aims to make working with information more natural. It allows the digital world to be writable like the physical world. FluidDB has a simple data model of objects with tags and values that are organized into namespaces. It provides a query language and permissions system to control access. The database has a RESTful API and client libraries in many languages to make it easy to integrate with applications. FluidDB's goal is to be a flexible, collaborative database like a computational wiki.

Technology

FluidDB
Terry Jones

terry@ﬂuidinfo.com
@terrycojones

The physical world
is writable

(in some sense)

And we (programmers)
have looked after our
own needs pretty well

Making a problem disappear
1
2
4
8
16
32
64
128
256
512
1024 +
?????

Making a problem disappear
1 1
2 10
4 100
8 1000
16 10000
32 100000
64 1000000
128 10000000
256 100000000
512 1000000000
1024 + 10000000000 +
????? 11111111111

Representation
VIII
XVII
XLIV
LXXX
XCVI
CCLV

Representation
VIII
XVII
XLIV
LXXX
XCVI
CCLV +
D

FluidDB

Make working with information more natural
Make the (computational) world writable
A single global shared database
The database with the heart of a wiki?

Python libs

Fluid Object Mapper (FOM), by Ali Afshar
fdb.py, by Nicholas Radcliffe
txFluidDB (Twisted!), by Tristan Seligmann
FluidDB Explorer, by Pier Parent

A FluidDB object
t witter.com/friends/jack
t witter.com/users/screen_name hmason
t witter.com/users/status_count 4191
terrycojones/met
terrycojones/people/works-at-bitly
ﬂuiddb/about “t witter.com:uid:765548”
sally/comment “badass coder”
jamie/rating 7

FluidDB is mainly Python

Twisted (http:/ wistedmatrix.com)
/t
AMQP (txAMQP, RabbitMQ)
Thrift (txThrift)
Pyjamas (for Tickery)
txJSONRPC (Tickery)

More info
Private alpha sign up:
http://ﬂuidinfo.com/accounts/new
Then mail api@ﬂuidinfo.com
Blog: http://blogs.ﬂuidinfo.com/ﬂuidDB
Docs: http://doc.ﬂuidinfo.com/ﬂuidDB

Information model
Objects with tags (with values)
Objects have no owners
A permissions system on tags
Tags organized into namespaces
A simple query language

Queries
Numeric: tag value (=, <, etc.)
Set contents: tag contains “great”
Exclusion: price > 20 except rating < 3
Tag presence: has tag
Grouping/logic: (...), and, or
Textual: tag text match (coming!)

Permissions

For each action on a namespace or tag:
There’s a policy: ‘open’ or ‘closed’
And a (perhaps empty) list of exceptions

API

HTTP / REST based
JSON arguments & replies
A dozen client-side libraries (Python,
Perl, Ruby, .Net, Java, etc)
Other APIs planned (XMPP, Thrift)

For research institutes, data libraries, and data archives, RDF data validation according to predefined constraints is a much sought-after feature, particularly as this is taken for granted in the XML world. Based on our work in the DCMI RDF Application Profiles Task Group and in cooperation with the W3C Data Shapes Working Group, we identified and published by today 81 types of constraints that are required by various stakeholders for data applications. In this paper, in collaboration with several domain experts we formulate 115 constraints on three different vocabularies (DDI-RDF, QB, and SKOS) and classify them according to (1) the severity of an occurring violation and (2) the complexity of the constraint expression in common constraint languages. We evaluate the data quality of 15,694 data sets (4.26 billion triples) of research data for the social, behavioral, and economic sciences obtained from 33 SPARQL endpoints. Based on the results, we formulate several findings to direct the further development of constraint languages.

Thinking in documents

César Rodas

Better Cross-Channel Experiences With Metadata - Information Architecture Sum...

aungstad

Metadata provides a foundation for the cross-channel experiences we consume in the dawn of the 21st century by enabling consistency, context and interoperability. While Metadata is key to many of the User Experience methods we use – from triggering Content Strategy workflows to enabling faceted search through groups, sorts and filters, it remains a mystery to many of us. This session is a crash course on Metadata in the 21st century for UX Designers. We'll look at recent developments in the field, and build an understanding of how Metadata enables the exchange of information between parties, channels, systems and platforms through semantic, syntax and lexical specifications. Attendees will understand how Metadata fits into UX methods and tools they already know – using an ontology to support a mental model for example. This session is a must for all UX Designers looking to build meaningful cross-channel experiences in an increasingly interlinked world.

Two graph data models : RDF and Property Graphs

andyseaborne

總之來講講 Search

Andy Dai

2013 CrossRef Workshops Boot Camp Introduction Patricia Feeney

Crossref

Semantic Web introduction

Graphity

Non-Framework MVC sites with PHP

César Rodas

RDF Data Model

Jose Emilio Labra Gayo

Scaling Out With Hadoop And HBase

Age Mooij

The Elephant in the Library - Integrating Hadoop

cneudecker

Small, Medium and Big DataPierre De Wilde

Flink Forward Europe 2019 - Berlin

David Morin

container crash course

Andrew Shafer

High level introduction to Linux Containers. Presented at Interop Las Vegas 2015. Frames the discussion with an introduction to intermodal shipping containers, the innovation around logistics and purpose built infrastructure and the impact. Walk through features of the Linux kernel which provide isolation and limitation and packaging applications as filesystem images. Finish talking about the emerging purpose built infrastructure for managing container deployments.

OVH-Change Data Capture in production with Apache Flink - Meetup Rennes 2019-...

Yann Pauly

Drive the business with your KPIs. That is what we aimed to do at OVH. As a 18 years old company and quite big cloud provider, we encountered several issues during this long journey to setup change data capture and data driven culture. Getting data from thousands of tables into one place, keep it all up to date was not possible without a strong streaming engine like Apache Flink. We will present you our current production pipeline with its pros and cons. From the data collection made directly with binary logs of the databases, to continuous writing into Apache Hive in a Kerberized cloud-based Apache Hadoop cluster. We will describe how we handle schema transcription, events lifecycle, stream partitioning, sort of the events with the use of watermarks and windows aggregation - all of this in a transaction way until the data availability on user side. Finally we will introduce our production infrastructure based on cloud only, its operation and monitoring.

Rennes Meetup 2019-09-26 - Change data capture in production

David Morin

BigchainDB: A Scalable Blockchain Database, In Python

Trent McConaghy

Trent McConaghy- BigchainDB

PyData

BigchainDB: A Scalable Blockchain Database, In Python

BigchainDB

Talk at West Coast Association of Shared Resource DirectorsDeepak Singh

Functional Programming with Immutable Data Structures

elliando dias

PyLadies Seattle - Lessons in Interactive Visualizations

Amanda Casari

What's hot

2016.02 - Validating RDF Data Quality using Constraints to Direct the Develop...

Dr.-Ing. Thomas Hartmann

Thinking in documents

César Rodas

Better Cross-Channel Experiences With Metadata - Information Architecture Sum...

aungstad

Two graph data models : RDF and Property Graphs

andyseaborne

總之來講講 Search

Andy Dai

2013 CrossRef Workshops Boot Camp Introduction Patricia Feeney

Crossref

Semantic Web introduction

Graphity

Non-Framework MVC sites with PHP

César Rodas

RDF Data Model

Jose Emilio Labra Gayo

What's hot (9)

2016.02 - Validating RDF Data Quality using Constraints to Direct the Develop...

Thinking in documents

Better Cross-Channel Experiences With Metadata - Information Architecture Sum...

Two graph data models : RDF and Property Graphs

總之來講講 Search

2013 CrossRef Workshops Boot Camp Introduction Patricia Feeney

Semantic Web introduction

Non-Framework MVC sites with PHP

RDF Data Model

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

How world-class product teams are winning in the AI era by CEO and Founder, P...

Product School

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

The Art of the Pitch: WordPress Relationships and Sales

Laura Byrne

Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes? All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

Recently uploaded (20)

DevOps and Testing slides at DASA Connect

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

Epistemic Interaction - tuning interfaces to provide information for AI support

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

Neuro-symbolic is not enough, we need neuro-*semantic*

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Assuring Contact Center Experiences for Your Customers With ThousandEyes

Generating a custom Ruby SDK for your web service or Rails API using Smithy

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

How world-class product teams are winning in the AI era by CEO and Founder, P...

Leading Change strategies and insights for effective change management pdf 1.pdf

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

The Art of the Pitch: WordPress Relationships and Sales

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

FluidDB NYC Python presentation

1. FluidDB Terry Jones terry@ﬂuidinfo.com @terrycojones

2. Information

3. The physical world is writable (in some sense)

8. Our brains are writable

9. And we (programmers) have looked after our own needs pretty well

10. A magic trick

11. Making a problem disappear 1 2 4 8 16 32 64 128 256 512 1024 + ?????

12. Making a problem disappear 1 1 2 10 4 100 8 1000 16 10000 32 100000 64 1000000 128 10000000 256 100000000 512 1000000000 1024 + 10000000000 + ????? 11111111111

13. Representation VIII XVII XLIV LXXX XCVI CCLV

14. Representation VIII XVII XLIV LXXX XCVI CCLV +

15. Representation VIII XVII XLIV LXXX XCVI CCLV + D

16. Representation VIII XVII XLIV LXXX XCVI CCLV + D

17. FluidDB Make working with information more natural Make the (computational) world writable A single global shared database The database with the heart of a wiki?

18. A FluidDB app: Tickery

19. Python libs Fluid Object Mapper (FOM), by Ali Afshar fdb.py, by Nicholas Radcliffe txFluidDB (Twisted!), by Tristan Seligmann FluidDB Explorer, by Pier Parent

20. A FluidDB object t witter.com/friends/jack t witter.com/users/screen_name hmason t witter.com/users/status_count 4191 terrycojones/met terrycojones/people/works-at-bitly ﬂuiddb/about “t witter.com:uid:765548” sally/comment “badass coder” jamie/rating 7

21. FluidDB is mainly Python Twisted (http:/ wistedmatrix.com) /t AMQP (txAMQP, RabbitMQ) Thrift (txThrift) Pyjamas (for Tickery) txJSONRPC (Tickery)

22. More info Private alpha sign up: http://fluidinfo.com/accounts/new Then mail api@fluidinfo.com Blog: http://blogs.fluidinfo.com/fluidDB Docs: http://doc.fluidinfo.com/fluidDB

23. Information model Objects with tags (with values) Objects have no owners A permissions system on tags Tags organized into namespaces A simple query language

24. Queries Numeric: tag value (=, <, etc.) Set contents: tag contains “great” Exclusion: price > 20 except rating < 3 Tag presence: has tag Grouping/logic: (...), and, or Textual: tag text match (coming!)

25. Permissions For each action on a namespace or tag: There’s a policy: ‘open’ or ‘closed’ And a (perhaps empty) list of exceptions

26. API HTTP / REST based JSON arguments & replies A dozen client-side libraries (Python, Perl, Ruby, .Net, Java, etc) Other APIs planned (XMPP, Thrift)

FluidDB NYC Python presentation

Recommended

Recommended

More Related Content

What's hot

What's hot (9)

Similar to FluidDB NYC Python presentation

Similar to FluidDB NYC Python presentation (20)

Recently uploaded

Recently uploaded (20)

FluidDB NYC Python presentation