Trondheim Eclipe Day 2015 and 2016
•
0 likes•21 views
The Science Working Group is an international collaboration of scientific organizations that develops open-source software tools for scientific research. It has 15 member organizations from fields like neutron sources and synchrotrons. The group created reusable software like the General Data Analysis framework and DAWN data analysis workbench. Recent projects included adopting new technologies like OSGi and developing SWMR file support and extensions to DAWN like a Fano factor image filter.
Report
Share
Report
Share
Download to read offline
Recommended
Accelerating NLP with Dask on Saturn Cloud: A case study with CORD-19
Python has a great ecosystem of tools for natural language processing (NLP) pipelines, but challenges arise when data sizes and computational complexity grows. Best case, a pipeline is left to run overnight or even over several days. Worst case, certain analyses or computations are just not possible. Dask is a Python-native parallel processing tool that enables Python users to easily scale their code across a cluster of machines.
This talk presents an example of an NLP entity extraction pipeline using SciSpacy with Dask for parallelization, which was built and executed on Saturn Cloud. Saturn Cloud is an end-to-end data science and machine learning platform that provides an easy interface for Python environments and Dask clusters, removing many barriers to accessing parallel computing. This pipeline extracts named entities from the CORD-19 dataset, using trained models from the SciSpaCy project, and makes them available for downstream tasks in the form of structured Parquet files. We will provide an introduction to Dask and Saturn Cloud, then walk through the NLP code.
Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...
This document discusses using a Bayesian neural network to classify light curves from the Transiting Exoplanet Survey Satellite (TESS) mission to identify exoplanet candidates. It describes challenges in classifying large numbers of light curves, and how a Bayesian neural network approach provides probabilistic predictions and confidence levels to help identify promising exoplanet candidates while avoiding many false positives seen in other methods. The Bayesian network achieved 91% accuracy and 83% precision in tests on simulated TESS data.
Accelerating NLP with Dask and Saturn Cloud
This document provides an overview of a project to extract entities from the CORD-19 dataset using SciSpaCy named entity recognition models on a Dask cluster. The goals were to create standoff entity annotations for the CORD-19 papers and output the data in a structured format. The pipeline involved parsing papers to paragraphs, splitting paragraphs to sentences, and then extracting entities from sentences using various NER models. The output was stored in Parquet files that could be accessed via Dask or Spark. The project delivered Jupyter notebooks demonstrating the code and entity data in Parquet format totaling around 70GB.
Neo4j Spatial at LocationDay 2013 in Malmö
This document discusses using Neo4j-Spatial and OpenStreetMap to work with web map data. It provides an overview of Neo4j-Spatial's capabilities for spatial data including importing, querying, and exporting OpenStreetMap data. Examples are given of using Neo4j-Spatial to find locations near other points, perform routing queries on OSM data, and analyze contributions of individual OSM users.
Object Detection with Tensorflow
This document provides an overview of object detection with TensorFlow. It introduces object detection and the state of deep learning approaches. It then describes the TensorFlow Object Detection API for building, training and deploying object detection models. It outlines the steps for preparing a dataset by collecting and annotating images and converting them to TFRecord format. Finally, it discusses configuring, training and evaluating models using the API.
Rust in TiKV
This is the speech Siddon Tang gave at the 1st Rust Meetup in Beijing on April 16, 2017.
Siddon Tang：Chief Architect of PingCAP
The slide covered the following topics:
- Why do we use Rust in TiKV
- TiKV architecture introduction
- Key technology
- Future plan
Software maintenance PyConPL 2016
This document discusses strategies for maintaining legacy Python codebases. It begins with background on the presenter and an introduction to the topic. The bulk of the document outlines a three-part "maintenance framework": 1) Understand the system through documentation, debugging, profiling and testing; 2) Establish a safety net with automated tests, continuous integration, monitoring and automation; and 3) Improve the code and development practices through code quality tools, test-driven development, and code reviews. Emphasis is placed on understanding context, architecture and behavior before refactoring code and establishing collaborative processes to raise quality and knowledge sharing.
IPTC News Exchange Working Group 2013 Autumn Meeting
The IPTC's News Exchange Formats including NewsML-G2 and QCodes. Updating the documentation and fixing the problem of the XML Schema normalizedString type
Recommended
Accelerating NLP with Dask on Saturn Cloud: A case study with CORD-19
Python has a great ecosystem of tools for natural language processing (NLP) pipelines, but challenges arise when data sizes and computational complexity grows. Best case, a pipeline is left to run overnight or even over several days. Worst case, certain analyses or computations are just not possible. Dask is a Python-native parallel processing tool that enables Python users to easily scale their code across a cluster of machines.
This talk presents an example of an NLP entity extraction pipeline using SciSpacy with Dask for parallelization, which was built and executed on Saturn Cloud. Saturn Cloud is an end-to-end data science and machine learning platform that provides an easy interface for Python environments and Dask clusters, removing many barriers to accessing parallel computing. This pipeline extracts named entities from the CORD-19 dataset, using trained models from the SciSpaCy project, and makes them available for downstream tasks in the form of structured Parquet files. We will provide an introduction to Dask and Saturn Cloud, then walk through the NLP code.
Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...
This document discusses using a Bayesian neural network to classify light curves from the Transiting Exoplanet Survey Satellite (TESS) mission to identify exoplanet candidates. It describes challenges in classifying large numbers of light curves, and how a Bayesian neural network approach provides probabilistic predictions and confidence levels to help identify promising exoplanet candidates while avoiding many false positives seen in other methods. The Bayesian network achieved 91% accuracy and 83% precision in tests on simulated TESS data.
Accelerating NLP with Dask and Saturn Cloud
This document provides an overview of a project to extract entities from the CORD-19 dataset using SciSpaCy named entity recognition models on a Dask cluster. The goals were to create standoff entity annotations for the CORD-19 papers and output the data in a structured format. The pipeline involved parsing papers to paragraphs, splitting paragraphs to sentences, and then extracting entities from sentences using various NER models. The output was stored in Parquet files that could be accessed via Dask or Spark. The project delivered Jupyter notebooks demonstrating the code and entity data in Parquet format totaling around 70GB.
Neo4j Spatial at LocationDay 2013 in Malmö
This document discusses using Neo4j-Spatial and OpenStreetMap to work with web map data. It provides an overview of Neo4j-Spatial's capabilities for spatial data including importing, querying, and exporting OpenStreetMap data. Examples are given of using Neo4j-Spatial to find locations near other points, perform routing queries on OSM data, and analyze contributions of individual OSM users.
Object Detection with Tensorflow
This document provides an overview of object detection with TensorFlow. It introduces object detection and the state of deep learning approaches. It then describes the TensorFlow Object Detection API for building, training and deploying object detection models. It outlines the steps for preparing a dataset by collecting and annotating images and converting them to TFRecord format. Finally, it discusses configuring, training and evaluating models using the API.
Rust in TiKV
This is the speech Siddon Tang gave at the 1st Rust Meetup in Beijing on April 16, 2017.
Siddon Tang：Chief Architect of PingCAP
The slide covered the following topics:
- Why do we use Rust in TiKV
- TiKV architecture introduction
- Key technology
- Future plan
Software maintenance PyConPL 2016
This document discusses strategies for maintaining legacy Python codebases. It begins with background on the presenter and an introduction to the topic. The bulk of the document outlines a three-part "maintenance framework": 1) Understand the system through documentation, debugging, profiling and testing; 2) Establish a safety net with automated tests, continuous integration, monitoring and automation; and 3) Improve the code and development practices through code quality tools, test-driven development, and code reviews. Emphasis is placed on understanding context, architecture and behavior before refactoring code and establishing collaborative processes to raise quality and knowledge sharing.
IPTC News Exchange Working Group 2013 Autumn Meeting
The IPTC's News Exchange Formats including NewsML-G2 and QCodes. Updating the documentation and fixing the problem of the XML Schema normalizedString type
Mashup OpenStreetMap and Wikidata to Create Useful Vector Data
Geospatial vector files published by Elastic for our users are created by mashing up vector data from OpenStreetMap and attribute data from Wikidata using Sophox. In this talk, I demonstrate how you can use Sophox and SPARQL queries to generate useful vector data and attributes.
スマホでDeepLearning実践入門(α版)
TensorFlow Lite (TF Lite) allows running trained machine learning models on mobile and edge devices. The document discusses various methods for converting TensorFlow models to the TF Lite format including quantizing weights to reduce size. It also covers frameworks like Firebase MLKit, Core ML, and MediaPipe that utilize TF Lite on Android and iOS.
Kernel Recipes 2018 - Packets probes and eBPF filtering in Skydive - Nicolas ...
Efficient monitoring of large-scale networks poses a delicate balance between capture granularity on the one hand and the imposed overheads and performance penalties on the other. Skydive is an open source real-time network topology and protocol analyzer, featuring smart network collection which is both granular and efficient. Skydive allows for efficient network monitoring@scale through Linux networking features such as BPF and eBPF.
In the talk we will present Skydive. Focus on the usage of BPF in Skydive, and show how to capture network information efficiently. We will share some performance results showing the efficiency of Skydive BPF capturing.
Hadoop @ eBuddy
The document discusses eBuddy's use of Hadoop for data warehousing and analytics needs. It describes eBuddy's logging history and current large volume of login records. It outlines the needs of different teams for analysis. It then reviews eBuddy's timeline of using traditional RDBMS, custom MapReduce code, Pig scripts and migrating to Hive for SQL queries. The document discusses their current use of Hive, ETL processes, future plans to use Cassandra and streaming ETL to Flume and questions about Hive partition pruning and left outer joins in Pig.
LINEデリマでのElasticsearchの運用と監視の話
渡邊 紘太朗 (LINE株式会社 開発支援室)
LINEデリマでのElasticsearchの運用と監視の話
LINE Developer Meetup in Tokyo #27 -Elastic-の発表資料です
https://line.connpass.com/event/76226/
IIUG 2016 Gathering Informix data into R
A basics walk-through on how to setup R to work with Informix JDBC, ODBC, and ReST/JSON. After taking the datasets examples and uploading them to Informix you can also look through the http://www.slideshare.net/thoi_gian/iris-data-analysis-with-r?qid=414b5431-9759-49e7-b3ba-c89a7bb357be&v=&b=&from_search=1, but replace the data targets with Informix ReST/JSON. Hint since the iris dataset's column names have a non-Informix compliant character I used JSON to store the data into Informix. If you rename the column you can get the data into a normal table through JDBC or ODBC.
Example Iris to JSON to Informix through ReST:
library(datasets)
library(jsonlite)
library(httr)
data(iris)
myjson <-><-><-><->)
dataset[1:3]
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
The document discusses Michael Laing's role as an architect at Edge Engineering and his work on various projects. It mentions his "nyt⨍aбrik" project, work with distributed graphs using Cassandra and Titan, and notes he is exploring using Spark Streaming for online analytical processing. The document contains technical details about distributed systems, databases, and graph structures.
(chapter 7) A Concise and Practical Introduction to Programming Algorithms in...
These are the slides accompanying the textbook:
A Concise and Practical Introduction to Programming Algorithms in Java
by Frank Nielsen
Published by Springer-Verlag (2009), Undergraduate textbook in computer science (UTiCS series)
ISBN: 978-1-84882-338-9
http://www.lix.polytechnique.fr/~nielsen/JavaProgramming/
http://link.springer.com/book/10.1007%2F978-1-84882-339-6
Log Event Stream Processing In Flink Way
Logs are one of the most important sources to monitor and reveal some significant events of interest. In this presentation, we introduced an implementation of log streams processing architecture based on Apache Flink. With fluentd, different kinds of emitted logs are collected and sent to Kafka. After having processed by Flink, we try to build a dash board utilizing elasticsearch and kibana for visualization.
Modern Trends for C++ Dev Market
This document discusses modern trends for C++ development. While C++ is still widely used in areas like operating systems, large services, and games, its use has declined relative to other languages. This is due to factors like its steep learning curve and slow development speed. However, C++ remains important in specialized domains like aerospace, science/health technologies, and embedded systems. The document provides advice for C++ developers to stay relevant, such as pursuing freelance work, joining product companies, or specializing in niche areas. It also highlights GlobalLogic's C++ expertise and projects involving medical devices, automotive software, and network infrastructure.
ログ収集プラットフォーム開発におけるElasticsearchの運用
齋藤 智之 (LINE株式会社 開発3室)
ログ収集プラットフォーム開発におけるElasticsearchの運用
LINE Developer Meetup in Tokyo #27 -Elastic-の発表資料です
https://line.connpass.com/event/76226/
OM-JSON - a JSON implementation of O&M
This document proposes OM-JSON, a JSON implementation of the OGC Observations and Measurements (O&M) standard. It provides JSON schemas for representing different types of observations, such as single measurements, time series, geometries, specimens, and collections. Examples are given for each. Issues discussed include how to wrap the encodings for use in APIs/services, differences from other JSON schemas like those from 52North, and potential changes needed to the O&M abstract specification. The motion at the end recommends publishing OM-JSON as an OGC Discussion Paper.
11.11.22 かなり役立つ競技プログラミング
The document discusses KLab, an IT company that develops Android apps. It notes that KLab started developing Android apps after the Android 1.0 SDK was released in 2007. KLab also participates in programming competitions like ACM-ICPC and TopCoder. The document encourages readers to try Android development and participating in TopCoder competitions. It notes that over 75 million people have downloaded KLab's Android apps so far.
Spark + i python
The document discusses combining Spark and IPython for distributed computing. Spark is a distributed computation engine that runs on a cluster, while IPython provides an interactive computing environment. The goal is to connect IPython to a Spark cluster so developers can process large datasets interactively. This allows processing data at scale during development and easily exporting code to production. The document provides an overview of Spark and IPython architectures and demonstrates connecting an IPython kernel to a Spark context to develop Spark scripts interactively.
OSGi Community Event 2010 - OSGi and Terracotta - replication of states for c...
OSGi Community Event 2010 - OSGi and Terracotta - replication of states for clustered services (Anthony Gelibert - LIG Grenoble)
Array
The document defines arrays and various operations on arrays like traversal, search, insertion, deletion, sorting, and merging. It provides algorithms and programs for traversing, inserting, deleting, linear search, binary search, and bubble sort of arrays. Various array operations like traversal, insertion, deletion, searching and sorting are implemented through algorithms and C++ programs with sample inputs and outputs.
09_Dxt 압축 알고리즘 소개
DXT is a common texture compression format used for 3D graphics. It supports DXT1, DXT3, and DXT5 formats. DXT1 stores color data for 4x4 pixel blocks using 8 bits and interpolates colors to save storage. DXT3 adds an alpha channel. DXT5 stores alpha channel values separately for each pixel to improve transparency rendering quality. DXT compression is widely used due to its good compression ratio and support across graphics hardware and APIs.
Master Thesis Object Tracking in Video with TensorFlow
This is the presentation of my master thesis developed at the F.I.B. - UPC Barcelona Tech campus. The focus was the development of a working model for object tracking in video, only with the TensorFlow technology. The model had to be suitable for the ILSVRC VID 2016 challenge and its the first one, in the whole worldwide community of GitHub, totally developed in TensorFlow.
Core Project: http://bit.ly/2p6WUOM
Secondary Project:http://bit.ly/2q1YOxB
ORN architecture DBMS
The document outlines the ORN architecture for a DBMS that combines neural network, relational, and object-oriented layers. It describes the ORN architecture as having a neural network layer, relational layer, and object layer. It then discusses the operators, persistence, and poker algorithm aspects of the different layers.
Prov and real things
This document proposes using the W3C PROV ontology to describe specimen preparation workflows from collection to analysis. It suggests representing specimens as PROV entities, preparation steps as activities, and people and machines as agents. This allows capturing the transformations that specimens undergo and linking specimens and data to those who handled them. Mapping specimens to PROV entities addresses issues with prior models and can help evaluate and reproduce observations by making preparation details available as provenance.
Open stack @ iiit hyderabad
This document summarizes the work done by OpenStack@IIIT-H, which uses OpenStack to run an Indian language search engine, conduct research in information extraction/retrieval/access and virtualization/cloud computing, and provide users with OpenStack, Hadoop, and other open-source software. Before OpenStack, provisioning resources was ad hoc and unmanaged, user management lacked controls, and storage had reliability and duplication issues. After implementing OpenStack, resources can be quickly and reliably provisioned on demand, usage is monitored and restricted with quotas, and storage uses Swift for reliability without data fragmentation. OpenStack also supports research and teaching over 350 students through hands-on projects.
blueMarine Sailing with NetBeans Platform
The document introduces NetBeans Rich Client Platform (RCP) and blueMarine, an open source photo workflow management application built with NetBeans RCP. It discusses how NetBeans RCP provides a framework for developing desktop applications and demonstrates blueMarine's use of NetBeans RCP features like explorers, viewers, actions, and integrations with libraries like SwingLabs, NASA World Wind, Jini, and Rio. The document encourages using and contributing to blueMarine and NetBeans RCP.
More Related Content
What's hot
Mashup OpenStreetMap and Wikidata to Create Useful Vector Data
Geospatial vector files published by Elastic for our users are created by mashing up vector data from OpenStreetMap and attribute data from Wikidata using Sophox. In this talk, I demonstrate how you can use Sophox and SPARQL queries to generate useful vector data and attributes.
スマホでDeepLearning実践入門(α版)
TensorFlow Lite (TF Lite) allows running trained machine learning models on mobile and edge devices. The document discusses various methods for converting TensorFlow models to the TF Lite format including quantizing weights to reduce size. It also covers frameworks like Firebase MLKit, Core ML, and MediaPipe that utilize TF Lite on Android and iOS.
Kernel Recipes 2018 - Packets probes and eBPF filtering in Skydive - Nicolas ...
Efficient monitoring of large-scale networks poses a delicate balance between capture granularity on the one hand and the imposed overheads and performance penalties on the other. Skydive is an open source real-time network topology and protocol analyzer, featuring smart network collection which is both granular and efficient. Skydive allows for efficient network monitoring@scale through Linux networking features such as BPF and eBPF.
In the talk we will present Skydive. Focus on the usage of BPF in Skydive, and show how to capture network information efficiently. We will share some performance results showing the efficiency of Skydive BPF capturing.
Hadoop @ eBuddy
The document discusses eBuddy's use of Hadoop for data warehousing and analytics needs. It describes eBuddy's logging history and current large volume of login records. It outlines the needs of different teams for analysis. It then reviews eBuddy's timeline of using traditional RDBMS, custom MapReduce code, Pig scripts and migrating to Hive for SQL queries. The document discusses their current use of Hive, ETL processes, future plans to use Cassandra and streaming ETL to Flume and questions about Hive partition pruning and left outer joins in Pig.
LINEデリマでのElasticsearchの運用と監視の話
渡邊 紘太朗 (LINE株式会社 開発支援室)
LINEデリマでのElasticsearchの運用と監視の話
LINE Developer Meetup in Tokyo #27 -Elastic-の発表資料です
https://line.connpass.com/event/76226/
IIUG 2016 Gathering Informix data into R
A basics walk-through on how to setup R to work with Informix JDBC, ODBC, and ReST/JSON. After taking the datasets examples and uploading them to Informix you can also look through the http://www.slideshare.net/thoi_gian/iris-data-analysis-with-r?qid=414b5431-9759-49e7-b3ba-c89a7bb357be&v=&b=&from_search=1, but replace the data targets with Informix ReST/JSON. Hint since the iris dataset's column names have a non-Informix compliant character I used JSON to store the data into Informix. If you rename the column you can get the data into a normal table through JDBC or ODBC.
Example Iris to JSON to Informix through ReST:
library(datasets)
library(jsonlite)
library(httr)
data(iris)
myjson <-><-><-><->)
dataset[1:3]
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
The document discusses Michael Laing's role as an architect at Edge Engineering and his work on various projects. It mentions his "nyt⨍aбrik" project, work with distributed graphs using Cassandra and Titan, and notes he is exploring using Spark Streaming for online analytical processing. The document contains technical details about distributed systems, databases, and graph structures.
(chapter 7) A Concise and Practical Introduction to Programming Algorithms in...
These are the slides accompanying the textbook:
A Concise and Practical Introduction to Programming Algorithms in Java
by Frank Nielsen
Published by Springer-Verlag (2009), Undergraduate textbook in computer science (UTiCS series)
ISBN: 978-1-84882-338-9
http://www.lix.polytechnique.fr/~nielsen/JavaProgramming/
http://link.springer.com/book/10.1007%2F978-1-84882-339-6
Log Event Stream Processing In Flink Way
Logs are one of the most important sources to monitor and reveal some significant events of interest. In this presentation, we introduced an implementation of log streams processing architecture based on Apache Flink. With fluentd, different kinds of emitted logs are collected and sent to Kafka. After having processed by Flink, we try to build a dash board utilizing elasticsearch and kibana for visualization.
Modern Trends for C++ Dev Market
This document discusses modern trends for C++ development. While C++ is still widely used in areas like operating systems, large services, and games, its use has declined relative to other languages. This is due to factors like its steep learning curve and slow development speed. However, C++ remains important in specialized domains like aerospace, science/health technologies, and embedded systems. The document provides advice for C++ developers to stay relevant, such as pursuing freelance work, joining product companies, or specializing in niche areas. It also highlights GlobalLogic's C++ expertise and projects involving medical devices, automotive software, and network infrastructure.
ログ収集プラットフォーム開発におけるElasticsearchの運用
齋藤 智之 (LINE株式会社 開発3室)
ログ収集プラットフォーム開発におけるElasticsearchの運用
LINE Developer Meetup in Tokyo #27 -Elastic-の発表資料です
https://line.connpass.com/event/76226/
OM-JSON - a JSON implementation of O&M
This document proposes OM-JSON, a JSON implementation of the OGC Observations and Measurements (O&M) standard. It provides JSON schemas for representing different types of observations, such as single measurements, time series, geometries, specimens, and collections. Examples are given for each. Issues discussed include how to wrap the encodings for use in APIs/services, differences from other JSON schemas like those from 52North, and potential changes needed to the O&M abstract specification. The motion at the end recommends publishing OM-JSON as an OGC Discussion Paper.
11.11.22 かなり役立つ競技プログラミング
The document discusses KLab, an IT company that develops Android apps. It notes that KLab started developing Android apps after the Android 1.0 SDK was released in 2007. KLab also participates in programming competitions like ACM-ICPC and TopCoder. The document encourages readers to try Android development and participating in TopCoder competitions. It notes that over 75 million people have downloaded KLab's Android apps so far.
Spark + i python
The document discusses combining Spark and IPython for distributed computing. Spark is a distributed computation engine that runs on a cluster, while IPython provides an interactive computing environment. The goal is to connect IPython to a Spark cluster so developers can process large datasets interactively. This allows processing data at scale during development and easily exporting code to production. The document provides an overview of Spark and IPython architectures and demonstrates connecting an IPython kernel to a Spark context to develop Spark scripts interactively.
OSGi Community Event 2010 - OSGi and Terracotta - replication of states for c...
OSGi Community Event 2010 - OSGi and Terracotta - replication of states for clustered services (Anthony Gelibert - LIG Grenoble)
Array
The document defines arrays and various operations on arrays like traversal, search, insertion, deletion, sorting, and merging. It provides algorithms and programs for traversing, inserting, deleting, linear search, binary search, and bubble sort of arrays. Various array operations like traversal, insertion, deletion, searching and sorting are implemented through algorithms and C++ programs with sample inputs and outputs.
09_Dxt 압축 알고리즘 소개
DXT is a common texture compression format used for 3D graphics. It supports DXT1, DXT3, and DXT5 formats. DXT1 stores color data for 4x4 pixel blocks using 8 bits and interpolates colors to save storage. DXT3 adds an alpha channel. DXT5 stores alpha channel values separately for each pixel to improve transparency rendering quality. DXT compression is widely used due to its good compression ratio and support across graphics hardware and APIs.
Master Thesis Object Tracking in Video with TensorFlow
This is the presentation of my master thesis developed at the F.I.B. - UPC Barcelona Tech campus. The focus was the development of a working model for object tracking in video, only with the TensorFlow technology. The model had to be suitable for the ILSVRC VID 2016 challenge and its the first one, in the whole worldwide community of GitHub, totally developed in TensorFlow.
Core Project: http://bit.ly/2p6WUOM
Secondary Project:http://bit.ly/2q1YOxB
ORN architecture DBMS
The document outlines the ORN architecture for a DBMS that combines neural network, relational, and object-oriented layers. It describes the ORN architecture as having a neural network layer, relational layer, and object layer. It then discusses the operators, persistence, and poker algorithm aspects of the different layers.
Prov and real things
This document proposes using the W3C PROV ontology to describe specimen preparation workflows from collection to analysis. It suggests representing specimens as PROV entities, preparation steps as activities, and people and machines as agents. This allows capturing the transformations that specimens undergo and linking specimens and data to those who handled them. Mapping specimens to PROV entities addresses issues with prior models and can help evaluate and reproduce observations by making preparation details available as provenance.
What's hot (20)
Mashup OpenStreetMap and Wikidata to Create Useful Vector Data
Mashup OpenStreetMap and Wikidata to Create Useful Vector Data
Kernel Recipes 2018 - Packets probes and eBPF filtering in Skydive - Nicolas ...
Kernel Recipes 2018 - Packets probes and eBPF filtering in Skydive - Nicolas ...
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
(chapter 7) A Concise and Practical Introduction to Programming Algorithms in...
(chapter 7) A Concise and Practical Introduction to Programming Algorithms in...
OSGi Community Event 2010 - OSGi and Terracotta - replication of states for c...
OSGi Community Event 2010 - OSGi and Terracotta - replication of states for c...
Master Thesis Object Tracking in Video with TensorFlow
Master Thesis Object Tracking in Video with TensorFlow
Similar to Trondheim Eclipe Day 2015 and 2016
Open stack @ iiit hyderabad
This document summarizes the work done by OpenStack@IIIT-H, which uses OpenStack to run an Indian language search engine, conduct research in information extraction/retrieval/access and virtualization/cloud computing, and provide users with OpenStack, Hadoop, and other open-source software. Before OpenStack, provisioning resources was ad hoc and unmanaged, user management lacked controls, and storage had reliability and duplication issues. After implementing OpenStack, resources can be quickly and reliably provisioned on demand, usage is monitored and restricted with quotas, and storage uses Swift for reliability without data fragmentation. OpenStack also supports research and teaching over 350 students through hands-on projects.
blueMarine Sailing with NetBeans Platform
The document introduces NetBeans Rich Client Platform (RCP) and blueMarine, an open source photo workflow management application built with NetBeans RCP. It discusses how NetBeans RCP provides a framework for developing desktop applications and demonstrates blueMarine's use of NetBeans RCP features like explorers, viewers, actions, and integrations with libraries like SwingLabs, NASA World Wind, Jini, and Rio. The document encourages using and contributing to blueMarine and NetBeans RCP.
Cork JUG - Drools basics & pitfalls
This document provides an overview of Drools, including its history, core functionality, and common pitfalls. It summarizes that Drools is a rule engine that was created in 2003 and has evolved through several versions to become part of the broader KIE platform. It describes Drools' rule structure and execution cycle, and highlights some common usage best practices and issues to avoid, such as overcomplicating rules or causing infinite loops. The document concludes by outlining Drools' roadmap, including a focus on cloud deployments, tooling, and language improvements.
Testing data streaming applications
As companies adopt data processing technologies and add data-driven features to user-facing products, the need for effective automated test techniques for data processing applications increase. We go through anatomy of scalable data streaming applications, and how to set up test harnesses for reliable integration testing of such applications. We cover a few common anti-patterns that make asynchronous tests fragile, and corresponding patterns for remediation. We will also mention virtualisation components suitable for our testing scenarios.
OpenStack Boston Meetup - April 20th 2017
Stacy Véronneau gave a presentation on the state of OpenStack at the Boston MeetUp in April 2017. The presentation included information about OpenStack releases, deployment statistics, common workloads, and ongoing challenges with enterprise adoption and day-2 operations. It also described CloudOps and their work helping customers leverage open source cloud technologies. The presentation concluded with a question and answer panel discussion on topics like business reasons for OpenStack, deployment, storage, networking, and operational challenges.
Spark Meetup at Uber
1) Uber uses Spark and Hadoop to process large amounts of transportation data in real-time and batch. This includes building pipelines to ingest trip data from databases into a data warehouse within 1-2 hours.
2) Paricon is Uber's first Spark application which infers schemas from raw JSON data, converts it to Parquet format for faster querying, and validates the results. It processes over 15TB of data daily.
3) Future work includes building a SQL-based ETL platform on Spark, open sourcing SQL-on-Hadoop, and creating a machine learning platform with Spark and a real-time analytics system called Apollo using Spark Streaming.
Netflix Open Source: Building a Distributed and Automated Open Source Program
Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.
Building a Distributed & Automated Open Source Program at Netflix
Andrew Spyker
Senior Software Engineer for Netflix
Find more by Andrew Spyker: http://www.slideshare.net/aspyker
All Things Open
October 26-27, 2016
Raleigh, North Carolina
OpenStack Cinder On-Boarding Education - Boston Summit - 2017
These slides were presented at the Boston Summit for people interested in learning how to start contributing to OpenStack's Block Storage project, Cinder. Includes an overview of Cinder's architecture, an introduction to our development processes and a description of our code tree.
Eclipse RCP for Synchrotron Science
- DawnScience is an open source not-for-profit project on GitHub developed by Diamond Light Source Ltd. and the ESRF, which are largely publicly funded research facilities
- The project provides software for controlling experiments, analyzing and visualizing multi-dimensional scientific data, and running analysis pipelines during experiments
- It utilizes several Eclipse and Apache technologies and dependencies including Eclipse RCP, Buckminster, Git/eGit, GEF, Draw2D, and HDF5
The benefits of running Spark on your own Docker
Shir Bromberg (Big Data team leader) @ Yotpo:
Nowadays, many of an organization’s main applications rely on Spark pipelines. As these applications become more significant to businesses, so does the need to quickly deploy, test and monitor them.
The standard way of running spark jobs is to deploy it on a dedicated managed cluster. However, this solution is relatively expensive with potentially high setup time. Therefore, we developed a way to run Spark on any container orchestration platform. This allows us to run Spark in a simple, custom and testable way.
In this talk, we will present our open-source dockers for running Spark on Nomad servers. We will cover:
* The issues we had running spark on managed clusters and the solution we developed.
* How to build a spark docker.
* And finally, what you may achieve by using Spark on Nomad.
Splunk, SIEMs, and Big Data - The Undercroft - November 2019
Guild members join us on Thursday November 14th at 6pm for our class on Splunk. Our Analyze Guild Master Jonathan Singer will be hitting on Centralized Logging, SEIM, Big Data, and much more.
Things we learned building a native IOS app
The document discusses lessons learned from building an iOS app called Plantola. It covers the building blocks of a great team with a clearly defined problem and core functionality. It also discusses critical decisions around native app development, database structure, design priorities, and timelines. Resources, tools, hurdles, and lessons learned from the process are provided. Advice is given to get outside feedback early, limit features, and delay major life changes.
Serverless Clojure and ML prototyping: an experience report
This document summarizes a serverless Clojure and machine learning application for prototyping. It describes the team building the application, the serverless AWS infrastructure using Terraform, CI/CD pipelines with GitHub Actions, the Clojure applications including a dashboard SPA and event processor, and natural language processing using Haystack and SageMaker batch transforms. The application allows users to upload documents and questionnaires, select questions, and trigger inferences to find answers from the documents using ML models.
Ostd.ksplice.talk
This document discusses Ksplice, a technology that allows patching of the Linux kernel without requiring a reboot. Ksplice works by comparing the old and new object code of the kernel, generating a delta patch, and using address redirection to load the new code without interrupting running processes. It was developed at MIT and later acquired by Oracle. While promising for high availability systems, questions remain around its licensing and whether it infringes any patents.
Torch the light - Implementing Observability for Microservice Architectures
Talk was delivered at Kong Summit 2022
Abstract:
Cloud-native architectures are usually implemented using a distributed microservice architecture style. This furthers agility and flexibility since changes can rapidly be implemented, as the services are loosely coupled. But this comes at a price -- application monitoring becomes increasingly complex. In this talk, Sven Bernhardt will show how a basic observability strategy can easily be implemented without the need to alter your existing application logic. Sven will demonstrate: - How to use Kong Gateway and Kuma to facilitate consistent logs, metrics, and traces across all services. - How to trace down the complete request lifecycle starting from the first call to Kong Gateway - How Kuma makes inter-service communication transparently comprehensible - How the Grafana stack — consisting of Grafana, Prometheus, Loki and Tempo — can be used to gather all observability data in a central place and provide it for further analysis.
DataOps - Lean principles and lean practices
DataOps is the transformation of data processing from a craft with manual processes to an automated data factory. Lean principles, which have proven successful in manufacturing, are equally applicable for data factories. We will describe how lean principles can be applied in practice for successful data processing.
apacheairflow-160827123852.pdf
This document discusses Apache Airflow, a workflow management platform. It provides an overview of Airflow including its anatomy with Python job definitions, a rich CLI, and web UI. It also discusses Qubole's evaluation of options like Oozie, Pinball, and Luigi that led them to select Airflow. Key aspects of productionizing Airflow at Qubole included availability, reliability, security, and usability.
Mastering Terraform and the Provider for OCI
A presentation as well as a Github project that introduces and demonstrates some of the Oracle Cloud Infrastructure with Terraform.
AWS Big Data Demystified #1: Big data architecture lessons learned
AWS Big Data Demystified #1: Big data architecture lessons learned . a quick overview of a big data techonoligies, which were selected and disregard in our company
The video: https://youtu.be/l5KmaZNQxaU
dont forget to subcribe to the youtube channel
The website: https://amazon-aws-big-data-demystified.ninja/
The meetup : https://www.meetup.com/AWS-Big-Data-Demystified/
The facebook group : https://www.facebook.com/Amazon-AWS-Big-Data-Demystified-1832900280345700/
Similar to Trondheim Eclipe Day 2015 and 2016 (20)
Netflix Open Source: Building a Distributed and Automated Open Source Program
Netflix Open Source: Building a Distributed and Automated Open Source Program
Building a Distributed & Automated Open Source Program at Netflix
Building a Distributed & Automated Open Source Program at Netflix
OpenStack Cinder On-Boarding Education - Boston Summit - 2017
OpenStack Cinder On-Boarding Education - Boston Summit - 2017
Splunk, SIEMs, and Big Data - The Undercroft - November 2019
Splunk, SIEMs, and Big Data - The Undercroft - November 2019
Serverless Clojure and ML prototyping: an experience report
Serverless Clojure and ML prototyping: an experience report
Torch the light - Implementing Observability for Microservice Architectures
Torch the light - Implementing Observability for Microservice Architectures
AWS Big Data Demystified #1: Big data architecture lessons learned
AWS Big Data Demystified #1: Big data architecture lessons learned
More from Matthew Gerring
Presented at GeoCon 2015
Eclipse Science talk at GeoCon 2015 completed for Eclipse Foundation who were in talks with members of the conference at the time.
DAWN and Scientific Workflows
Talk given at Eclipse Con US in 2014 and to a small group at Berkeley Maths Department thanks to Christopher Brookes.
Geoscience and Microservices
A talk given at Eclipse Con France in 2018 about microservices used in Geoscience. Similar talk was also given at Landmark LIFE conference.
Demo eclipse science
Eclipse Science provides 10 projects related to scientific computing including projects for visualization, chemistry analysis, data analysis, numerical data manipulation, user interfaces for large datasets, scanning instruments, R programming, LaTeX documents, scientific workflows, and an integrated computational environment. The projects involve various companies and organizations and aim to support scientific domains through open source Eclipse technologies and APIs.
Eclipse Con Europe 2014 How to use DAWN Science Project
This document summarizes the DawnScience Eclipse project, which is an open source not-for-profit project on GitHub. It aims to provide APIs and reference implementations for loading, describing, slicing, transforming, and plotting multidimensional scientific data. Phase 1 from 2014-2015 defined long-term APIs and a reference implementation for HDF5 loading, data description, plotting, and slicing interfaces. Phase 2 in 2016 will release concrete implementations. The project utilizes Eclipse technologies and collaborates with scientific facilities.
Demo Eclipse Science
Eclipse science group presentation given at Eclipse Converge and Devoxx 2017 in California. These slides give an overview of projects in the Eclipse Science working group in 2017.
More from Matthew Gerring (6)
Eclipse Con Europe 2014 How to use DAWN Science Project
Eclipse Con Europe 2014 How to use DAWN Science Project
Recently uploaded
All you need to know about Spring Boot and GraalVM
All you need to know about Spring Boot and GraalVM 🐰
Using Query Store in Azure PostgreSQL to Understand Query Performance
Microsoft has added an excellent new extension in PostgreSQL on their Azure Platform. This session, presented at Posette 2024, covers what Query Store is and the types of information you can get out of it.
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
Are you ready to unlock the secrets hidden within Java thread dumps? Join us for a hands-on session where we'll delve into effective troubleshooting patterns to swiftly identify the root causes of production problems. Discover the right tools, techniques, and best practices while exploring *real-world case studies of major outages* in Fortune 500 enterprises. Engage in interactive lab exercises where you'll have the opportunity to troubleshoot thread dumps and uncover performance issues firsthand. Join us and become a master of Java thread dump analysis!
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.
Kubernetes at Scale: Going Multi-Cluster with Istio
Divine Odazie and Jubril Oyetunji share tips on Going Multi-Cluster with Istio Service Mesh at DevOpsDays Houston.
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
Explore the seamless transition to e-invoicing with this comprehensive guide tailored for Saudi Arabian businesses. Navigate the process effortlessly with step-by-step instructions designed to streamline implementation and enhance efficiency.
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
Regarding mobile operating systems, two major players dominate our thoughts: Android and iPhone. With Android leading the market, software development companies are focused on delivering apps compatible with this OS. Ensuring an app's functionality across various Android devices, OS versions, and hardware specifications is critical, making Android app testing essential.
Malibou Pitch Deck For Its €3M Seed Round
French start-up Malibou raised a €3 million Seed Round to develop its payroll and human resources
management platform for VSEs and SMEs. The financing round was led by investors Breega, Y Combinator, and FCVC.
E-commerce Development Services- Hornet Dynamics
For any business hoping to succeed in the digital age, having a strong online presence is crucial. We offer Ecommerce Development Services that are customized according to your business requirements and client preferences, enabling you to create a dynamic, safe, and user-friendly online store.
WWDC 2024 Keynote Review: For CocoaCoders Austin
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
Enums On Steroids - let's look at sealed classes !
These are slides for my session"Enums On Steroids - let's look at sealed classes !" - delivered among others, on Devoxx UK 2024 conference
Microservice Teams - How the cloud changes the way we work
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Consistent toolbox talks are critical for maintaining workplace safety, as they provide regular opportunities to address specific hazards and reinforce safe practices.
These brief, focused sessions ensure that safety is a continual conversation rather than a one-time event, which helps keep safety protocols fresh in employees' minds. Studies have shown that shorter, more frequent training sessions are more effective for retention and behavior change compared to longer, infrequent sessions.
Engaging workers regularly, toolbox talks promote a culture of safety, empower employees to voice concerns, and ultimately reduce the likelihood of accidents and injuries on site.
The traditional method of conducting safety talks with paper documents and lengthy meetings is not only time-consuming but also less effective. Manual tracking of attendance and compliance is prone to errors and inconsistencies, leading to gaps in safety communication and potential non-compliance with OSHA regulations. Switching to a digital solution like Safelyio offers significant advantages.
Safelyio automates the delivery and documentation of safety talks, ensuring consistency and accessibility. The microlearning approach breaks down complex safety protocols into manageable, bite-sized pieces, making it easier for employees to absorb and retain information.
This method minimizes disruptions to work schedules, eliminates the hassle of paperwork, and ensures that all safety communications are tracked and recorded accurately. Ultimately, using a digital platform like Safelyio enhances engagement, compliance, and overall safety performance on site. https://safelyio.com/
Oracle 23c New Features For DBAs and Developers.pptx
Most important New features of Oracle 23c for DBAs and Developers. You can get more idea from my youtube channel video from https://youtu.be/XvL5WtaC20A
The Rising Future of CPaaS in the Middle East 2024
Explore "The Rising Future of CPaaS in the Middle East in 2024" with this comprehensive PPT presentation. Discover how Communication Platforms as a Service (CPaaS) is transforming communication across various sectors in the Middle East.
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
Charla impartida en el evento de "KuberTENes Birthday Bash Guadalajara" para celebrar el 10mo. aniversario de Kubernetes #kuberTENes #celebr8k8s #k8s
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
原版一模一样【微信：741003700 】【(sdsu毕业证书)圣地亚哥州立大学毕业证成绩单】【微信：741003700 】学位证，留信认证（真实可查，永久存档）原件一模一样纸张工艺/offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原。
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
【主营项目】
一.毕业证【q微741003700】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！
二.真实使馆公证(即留学回国人员证明,不成功不收费)
三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）
四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度)
如果您处于以下几种情况：
◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【q/微741003700】
◇面对父母的压力，希望尽快拿到；
◇不清楚认证流程以及材料该如何准备；
◇回国时间很长，忘记办理；
◇回国马上就要找工作，办给用人单位看；
◇企事业单位必须要求办理的
◇需要报考公务员、购买免税车、落转户口
◇申请留学生创业基金
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
办理(sdsu毕业证书)圣地亚哥州立大学毕业证【微信：741003700 】外观非常简单，由纸质材料制成，上面印有校徽、校名、毕业生姓名、专业等信息。
办理(sdsu毕业证书)圣地亚哥州立大学毕业证【微信：741003700 】格式相对统一，各专业都有相应的模板。通常包括以下部分：
校徽：象征着学校的荣誉和传承。
校名:学校英文全称
授予学位：本部分将注明获得的具体学位名称。
毕业生姓名：这是最重要的信息之一，标志着该证书是由特定人员获得的。
颁发日期：这是毕业正式生效的时间，也代表着毕业生学业的结束。
其他信息：根据不同的专业和学位，可能会有一些特定的信息或章节。
办理(sdsu毕业证书)圣地亚哥州立大学毕业证【微信：741003700 】价值很高，需要妥善保管。一般来说，应放置在安全、干燥、防潮的地方，避免长时间暴露在阳光下。如需使用，最好使用复印件而不是原件，以免丢失。
综上所述，办理(sdsu毕业证书)圣地亚哥州立大学毕业证【微信：741003700 】是证明身份和学历的高价值文件。外观简单庄重，格式统一，包括重要的个人信息和发布日期。对持有人来说，妥善保管是非常重要的。
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
UMN硕士毕业证成绩单【微信95270640】购买（明尼苏达大学毕业证成绩单硕士学历）Q微信95270640代办UMN学历认证留信网伪造明尼苏达大学学位证书精仿明尼苏达大学本科/硕士文凭证书补办明尼苏达大学 diplomaoffer,Transcript购买明尼苏达大学毕业证成绩单购买UMN假毕业证学位证书购买伪造明尼苏达大学文凭证书学位证书,专业办理雅思、托福成绩单，学生ID卡，在读证明，海外各大学offer录取通知书，毕业证书，成绩单，文凭等材料:1:1完美还原毕业证、offer录取通知书、学生卡等各种在读或毕业材料的防伪工艺（包括 烫金、烫银、钢印、底纹、凹凸版、水印、防伪光标、热敏防伪、文字图案浮雕，激光镭射，紫外荧光，温感光标）学校原版上有的工艺我们一样不会少，不论是老版本还是最新版本，都能保证最高程度还原，力争完美以求让所有同学都能享受到完美的品质服务。
#毕业证成绩单 #毕业証 #成绩单 #學生卡 #OFFER录取通知书 #雅思#托福等……
国外大学明尼苏达大学明尼苏达大学毕业证offer制作方法（一对一专业服务）
1客户提供办理信息：姓名生日专业学位毕业时间等（如信息不确定可以咨询顾问：我们有专业老师帮你查询）；
2开始安排制作毕业证成绩单电子图；
3毕业证成绩单电子版做好以后发送给您确认；
4毕业证成绩单电子版您确认信息无误之后安排制作成品；
5成品做好拍照或者视频给您确认；
6快递给客户（国内顺丰国外DHLUPS等快读邮寄）
— — 制作工艺 【高仿真】— —
凭借多年的制作经验本公司制作明尼苏达大学明尼苏达大学毕业证offer《激光》《水印》《钢印》《烫金》《紫外线》凹凸版uv版等防伪技术一流高精仿度几乎跟学校100%相同！让您绝对满意。
— — -公司理念 【诚信为主】— — —
我們以質量求生存.以服务求发展有雄厚的实力专业的团队咨询顾问为您细心解答可详谈是真是假眼见为实让您真正放心平凡人生,尽我所能助您一臂之力让我們携手圆您梦想!
此贴长年有效【贴心专线/微-信: 95270640】敬请保留此联系方式以备用！如有不在线请给我们留言！我们将在第一时间给您回复!上散发着一抹抹的光晕而这每处自然形成的细节融合在一起浑然天成的美实在令人心生愉悦小道的周边无秩序的生长着几株艳丽的野花红的粉的紫的虽混乱无章却给这幅美景更增添一份性感夹杂着一份纯洁的妖娆毫无违和感实在给人带来一份悠然幸福的心情如果说现在的审美已经断然拒绝了无声的话那么在树林间飞掠而过的小鸟叽叽咋咋的叫声是否就是这最后的点睛之笔悠然走在林间的小路上宁静与清香一丝丝的盛夏气息吸入身体昔日生活里的繁忙多
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
Presentation from Ghazal Aakel and Eric Jochum at the GSD Community Stage Meetup on June 6th, 2024
Recently uploaded (20)
All you need to know about Spring Boot and GraalVM
All you need to know about Spring Boot and GraalVM
Using Query Store in Azure PostgreSQL to Understand Query Performance
Using Query Store in Azure PostgreSQL to Understand Query Performance
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
Enums On Steroids - let's look at sealed classes !
Enums On Steroids - let's look at sealed classes !
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Oracle 23c New Features For DBAs and Developers.pptx
Oracle 23c New Features For DBAs and Developers.pptx
The Rising Future of CPaaS in the Middle East 2024
The Rising Future of CPaaS in the Middle East 2024
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
Migration From CH 1.0 to CH 2.0 and Mule 4.6 & Java 17 Upgrade.pptx
Migration From CH 1.0 to CH 2.0 and Mule 4.6 & Java 17 Upgrade.pptx
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
Trondheim Eclipe Day 2015 and 2016
- 1. Science Working Group ● Itema and DLS did a project! ○ Software Professionals + Big Science ○ Create standard or reusable things ○ Other contractors with ORNL in 2016 ● Eclipse January Adopted! ● Soleil Synchrotron Join! ● 15 Other Members ○ Neutron sources... ● New Lightweight IP
- 2. Synchrotrons
- 4. Hardware
- 5. e4 Products @ Diamond ● DAWN ○ On site / Off site Data Analysis ● GDA - Solstice ○ OSGi Server ○ Front end - RCP*, Python, Javascript ● Control System Studio * Main focus
- 6. GDA9 - Solstice ● In 2016 we embarked on a new project ○ OSGi server ○ SOA using OSGi Declarative Services ○ SWMR ○ Eclipse 4 (not Neon yet…) ○ AMQ messaging layer ○ New Scanning API
- 7. Case Study 1 : Copying e4 GDA1-8 used inheritance for scanning objects ● 100’s devices ● Inheritance Based ● No Arguments ● Only one method ● super.atScanStart()
- 8. Case Study 1 : Copying e4 GDA9 Uses Annotations
- 9. Case Study 2 : SWMR Many File Formats > HDF5 www.hdfgroup.org ● nD, mDataset binary file ● Devices converted to write SWMR ● Clients converted to read SWMR ● Data Analysis done with SWMR files ● DLS large contract with HDF5 Group ● HDF5 Group may join SWG
- 10. Case Study 2 : SWMR
- 11. DAWN ● DAWN 2.2 has been released ○ DAWN4DAWN (see demo) ○ 3D visualization of data ■ Isosurfaces ■ Volume Rendering ■ Small to Large (up to 100Gb) supported ○ Operations Pipeline Many Improvements ○ Data Mapping Features Added
- 12. DAWN4DAWN ● Itema and DLS worked together ○ Ability to extend DAWN ○ DAWN extension points supported ○ Deploy into running DAWN ○ Send extension to custom market place ■ All may share! ○ Known to be popular in Scientific tools
- 13. Problem Add a Fano Factor Filter to DAWN This allows images to be filtered 1. en.wikipedia.org/wiki/Fano_factor 2. en.wikipedia.org/wiki/Summed_area_table 3. Existing code SummedAreaTable 4. Add as an operation to ‘processing’
- 14. Demonstration
- 15. Marketplace - Share Extensions