2015 presentation
•
0 likes•409 views
This project was done under Prof. Jason Hogan (Assistant Professor) in Prof. Mark A. Kasevich's physics group, in collaboration with Raj Krishnakumar (Graduate Student). As a part of this project, I developed the front-end website of the lab's database, adding features such as graphing and event tracking to the page.
Report
Share
Report
Share
Download to read offline
Recommended
Resume xiaodan(vinci)
Xiaodan Chen is a data science professional with over 2 years of research experience in quantitative analysis and machine learning as well as 8 months of industry experience. Her skills include Python, SQL, AWS, and machine learning algorithms. She has worked on projects involving NLP, fraud detection, recommendation systems, A/B testing, and more.
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...The Statistical and Applied Mathematical Sciences Institute
In this talk, we discuss QuTrack, a Blockchain-based approach to track experiment and model changes primarily for AI and ML models. In addition, we discuss how change analytics can be used for process improvement and to enhance the model development and deployment processes. Lift & Shift to Azure
What to consider when moving to Microsoft Azure
The slide deck is about the observations, discoveries and obstacles we had to deal with while lifting and shifting the IT infrastructure of a few clients from either on-premise or from other hosting providers to Microsoft Azure.
This talk was given at the Azure Accelerator Conference by Liquid Telecom in Mauritius.
https://www.liquidtelecom.com/azure-accelerator-event-mauritius-2019.html
Accelerate your SAP BusinessObjects to the Cloud
This document provides guidance on migrating SAP BusinessObjects from an on-premise environment to the cloud. It outlines a five-phase methodology for a successful migration: 1) assessment and planning, 2) execution, 3) validation and optimization, 4) going live, and 5) day-to-day maintenance. The methodology aims to reduce costs and timelines by up to 80% by automating tasks like regression testing, content migration, and maintenance. This ensures the migrated platform performs as well as the original while inspiring user confidence.
Poster jsoe research expo 2008
The document describes Rich Feeds for RESCUE, a system developed by the California Institute for Telecommunications and Information Technology to provide data and multimedia feeds for disaster response and research. The system aggregates data from various external sources like traffic cameras and surveillance feeds. It then makes this data accessible through a web application with features for selecting, filtering, and visually exploring feeds on maps and over time. The system was designed with principles of service-oriented architecture to integrate new data sources and client applications easily while maintaining high performance and scalability.
Relevant Updated Data Retrieval Architectural Model for Continuous Text Extra...
The document proposes an architectural model for continuously retrieving relevant updated data from text streams using MapReduce techniques. It aims to address issues with existing systems that find it tough to monitor data streams, are time consuming with only servers able to process, require scanning entire document sets, and may retrieve duplicate documents. The proposed system uses multiple worker nodes running an incremental threshold algorithm to compute the k most relevant documents for a query in a distributed manner.
A Data API with Security and Graph-Level Access Control
The document discusses a data API with graph-level access control for managing queries and updates. It summarizes existing approaches that allow predefined parameterized queries subject to access controls and rewriting. It then outlines the British Museum's approach, which uses a RESTful API to manage queries and updates as resources with parameters, scheduling, and testing. Finally, it describes the ResearchSpace platform for enabling researchers to make claims on GLAM data while preserving canonical data across institutions.
Stanford summer project
This project was done under Dr Jason Hogan in Professor Mark Kasevich's lab at Stanford in Summer 2014. Using KICAD, I developed and designed an intelligent customizable PCB in order to shield the lab's devices and equipment from anomalies, disruptions and surges in the power supply.
Recommended
Resume xiaodan(vinci)
Xiaodan Chen is a data science professional with over 2 years of research experience in quantitative analysis and machine learning as well as 8 months of industry experience. Her skills include Python, SQL, AWS, and machine learning algorithms. She has worked on projects involving NLP, fraud detection, recommendation systems, A/B testing, and more.
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...The Statistical and Applied Mathematical Sciences Institute
In this talk, we discuss QuTrack, a Blockchain-based approach to track experiment and model changes primarily for AI and ML models. In addition, we discuss how change analytics can be used for process improvement and to enhance the model development and deployment processes. Lift & Shift to Azure
What to consider when moving to Microsoft Azure
The slide deck is about the observations, discoveries and obstacles we had to deal with while lifting and shifting the IT infrastructure of a few clients from either on-premise or from other hosting providers to Microsoft Azure.
This talk was given at the Azure Accelerator Conference by Liquid Telecom in Mauritius.
https://www.liquidtelecom.com/azure-accelerator-event-mauritius-2019.html
Accelerate your SAP BusinessObjects to the Cloud
This document provides guidance on migrating SAP BusinessObjects from an on-premise environment to the cloud. It outlines a five-phase methodology for a successful migration: 1) assessment and planning, 2) execution, 3) validation and optimization, 4) going live, and 5) day-to-day maintenance. The methodology aims to reduce costs and timelines by up to 80% by automating tasks like regression testing, content migration, and maintenance. This ensures the migrated platform performs as well as the original while inspiring user confidence.
Poster jsoe research expo 2008
The document describes Rich Feeds for RESCUE, a system developed by the California Institute for Telecommunications and Information Technology to provide data and multimedia feeds for disaster response and research. The system aggregates data from various external sources like traffic cameras and surveillance feeds. It then makes this data accessible through a web application with features for selecting, filtering, and visually exploring feeds on maps and over time. The system was designed with principles of service-oriented architecture to integrate new data sources and client applications easily while maintaining high performance and scalability.
Relevant Updated Data Retrieval Architectural Model for Continuous Text Extra...
The document proposes an architectural model for continuously retrieving relevant updated data from text streams using MapReduce techniques. It aims to address issues with existing systems that find it tough to monitor data streams, are time consuming with only servers able to process, require scanning entire document sets, and may retrieve duplicate documents. The proposed system uses multiple worker nodes running an incremental threshold algorithm to compute the k most relevant documents for a query in a distributed manner.
A Data API with Security and Graph-Level Access Control
The document discusses a data API with graph-level access control for managing queries and updates. It summarizes existing approaches that allow predefined parameterized queries subject to access controls and rewriting. It then outlines the British Museum's approach, which uses a RESTful API to manage queries and updates as resources with parameters, scheduling, and testing. Finally, it describes the ResearchSpace platform for enabling researchers to make claims on GLAM data while preserving canonical data across institutions.
Stanford summer project
This project was done under Dr Jason Hogan in Professor Mark Kasevich's lab at Stanford in Summer 2014. Using KICAD, I developed and designed an intelligent customizable PCB in order to shield the lab's devices and equipment from anomalies, disruptions and surges in the power supply.
Geant4 physics validation on the GRID
Geant4 is the main simulation framework used for hight energy physics. It is used by the majority of the LHC experiments in CERN for detector simulation. Physics validation is a form of regression testing, that ensures that the produced simulation data do agree with previous versions of the framework and follow similar patterns with real data acquired from the experiments.
I developed a new system that is able to formulate the process of running Geant4 applications/tests on the LHC world-wide computing grid (WLCG), gather the results, stores them in relational database for indexing and object storage and provide them to the user through an intuitive web user-interface that can run on-demand small analysis tasks.
Reactive Documents and Computational Pipelines - Bridging the Gap
As scientific discovery and experimentation become increasingly reliant on computational methods, the static nature of traditional publications renders them progressively fragmented and unreproducible. How can workflow automation tools, such as Globus, be leveraged to address these issues and potentially create a new, higher-value form of publication? LivePublication leverages Globus’s custom Action Provider integrations and Compute nodes to capture semantic and provenance information during distributed flow executions. This information is then embedded within an RO-crate and interfaced with a programmatic document, creating a seamless pipeline from instruments, to computation, to publication.
MongoDB & The McGraw-Hill Education Learning Analytics Platform
Mark will discuss building a storage and processing platform which takes in data as students perform homework, quizzes and tests and stores it in a MongoDB database. The output are visualizations with allow students and teachers to track their progress in a class.
Introduction to SoapUI day 3
This document provides an introduction to working with different types of test steps in SOAPUI, including protocol-oriented test steps for SOAP and REST requests, flow control test steps, properties, data-oriented test steps using data sources and data sinks, and exercises for practicing with these step types. It covers creating and configuring REST projects using URIs, WADLs, and service discovery in SOAPUI.
Using Oracle Big Data Discovey as a Data Scientist's Toolkit
As delivered at Trivadis Tech Event 2016 - how Big Data Discovery along with Python and pySpark was used to build predictive analytics models against wearables and smart home data
MongoDB for Spatio-Behavioral Data Analysis and Visualization
T-Sciences offers iSpatial - a web-based Spatial Data Infrastructure (SDI) to enable integration of third-party applications with geo-visualization tools. The iHarvest tool further enables the mining and analysis of data aggregated in the iSpatial platform for spatio-temporal behavior modelling. At the back-end of both products is MongoDB, providing fundamental framework capabilities for the spatial indexing and data analysis techniques. Come witness how Thermopylae Sciences and Technology leveraged the aggregation framework, and extended the spatial capabilities of MongoDB to tackle dynamic spatio-behavioral data at scale.
Math-Bridge Architecture
The document describes the architecture of a math training program called Math-Bridge. It includes components like Apache Tomcat for web delivery, Maverick as a model-view-controller framework, and a core component for system functionality. Content is stored and indexed in a ContentDB using technologies like Java, Lucene and OMDoc. A learner model tracks user progress. Other components include presentation of content, user accounts, exercises that interface with a computer algebra system, and a tutorial component. The program uses technologies like Java, databases, XMLRPC and XSLT to power its functionality.
2019-04-17 Bio-IT World G Suite-Jira Cloud Sample Tracking
The document describes building a low-cost sample tracking system using G Suite and Jira Cloud. It discusses using current off-the-shelf technology to create a serverless solution, how low-cost solutions can accelerate academic research, and developing the minimum viable product through iterative delivery. Permission to learn new skills can help develop capabilities to address problems and move research forward.
GeoDataspace: Simplifying Data Management Tasks with Globus
This document describes GeoDataspace, a framework for enabling data and model sharing in computational geosciences. GeoDataspace uses geounits, which package code, data, and environment, to capture scientific activities and research outputs. The Globus Catalog provides a flexible metadata catalog for hosting and querying geounits. GeoDataspace aims to improve reproducibility and enable validation of shared models and data through re-executing geounits. Several geoscience applications including plate tectonics, hydrology, and space science are discussed as potential adopters.
Apache Spark sql
Spark SQL provides relational data processing capabilities in Spark. It introduces a DataFrame API that allows both relational operations on external data sources and Spark's built-in distributed collections. The Catalyst optimizer improves performance by applying database query optimization techniques. It is highly extensible, making it easy to add data sources, optimization rules, and data types for domains like machine learning. Spark SQL evaluation shows it outperforms alternative systems on both SQL query processing and Spark program workloads involving large datasets.
An AMIS Overview of Oracle database 12c (12.1)
Presentation used by Lucas Jellema and Marco Gralike during the AMIS Oracle Database 12c Launch event on Monday the 15th of July 2013 (much thanks to Tom Kyte, Oracle, for being allowed to use some of his material)
M.
Performance Testing your Kuali Student Product
Faced with two critical goals and low resources, the Kuali Student Test Team developed and implemented a test automation framework based on an open source tool ? Tsung and Amazon?s Elastic Compute Cloud (EC2). This automation framework netted success right away as it allowed the team to identify and regress critical performance issues through out development.
Kuali developers and test engineers, and technical staff from implementing institutions will learn how industry best practices for performance testing were applied to Kuali Student and will walk away with guidance on how to setup and run an open source performance testing tool to support their needs (live demonstration included).
An AMIS overview of database 12c
AMIS organiseerde op maandagavond 15 juli het seminar ‘Oracle database 12c revealed’. Deze avond bood AMIS Oracle professionals de eerste mogelijkheid om de vernieuwingen in Oracle database 12c in actie te zien! De AMIS specialisten die meer dan een jaar bèta testen hebben uitgevoerd lieten zien wat er nieuw is en hoe we dat de komende jaren gaan inzetten!
Deze presentatie is deze avond gegeven als een plenaire sessie!
Functional Testing of RESTful Applications
This document discusses tools and techniques for functional testing of RESTful applications. It covers different levels of testing from unit to system level. It then describes using blackbox testing as a monitoring tool by generating test data, overcoming latency, and integrating with monitoring services. Graybox testing is discussed as a way to control external dependencies through mocking services. Finally, it recommends using Cucumber to develop business-focused test scenarios that are closer to documentation and easier to maintain.
QA Team Goes to Agile and Continuous integration
The document discusses how the QA team has transitioned to using agile and continuous integration methodologies to improve testing processes. It outlines several strategies for test automation, including using frameworks that break testing into reusable components and actions to increase efficiency and allow for parallel testing. The goal is to eliminate friction between developers and testers by enabling quick fixing of bugs and continued testing through virtual test data sharing.
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
1) Globus Genomics addresses challenges in sequencing analysis by providing a platform that integrates data transfer via Globus Online, workflow management in Galaxy, and scalable compute resources in AWS.
2) An example collaboration with the Dobyns Lab saw over a 10x speedup in exome data analysis by replacing a manual process with Globus Genomics.
3) Globus Genomics leverages XSEDE services like Globus Transfer and Nexus while integrating additional resources like sequencing centers and cloud computing, in order to reduce the costs and complexities of genomic research for communities not traditionally using advanced cyberinfrastructure.
Quick Test Professional (QTP/UFT)
In this quality assurance training session, you will learn QTP/UFT automation testing. Topics covered in this course are:
• Introduction to QTP
• Features of QTP
• Recording modes of QTP
• Object Repository
• Synchronization point
• Step Generator
• Object Spy
• Checkpoints
• Data-driven testing & Parameterization
• Working with actions
• Reporting in QTP
TO know more, visit this link: https://www.mindsmapped.com/courses/quality-assurance/get-practical-training-on-software-testing-quality-assurance-qa/
Globus Automation
We introduce the various Globus approaches available for automating data flows, including the command line interface (CLI), the Globus Timer service and the Globus Flows service.
Soap UI - Lesson3
This document provides an introduction and overview of various testing capabilities in SOAPUI, including:
- Protocol-oriented test steps for SOAP, REST, and JDBC requests
- Flow control test steps like properties, delays, scripts, and manual steps
- Using properties to transfer data between requests
- Adding assertions to validate test results
- Delay steps to control test flow timing
- Manual test steps to add human validation
- Data-oriented test steps for using data sources, loops, sinks, and generators
It includes exercises for hands-on practice with many of these features.
Data Interoperability Basics - Esri UC 2015
This session will focus on the functionality added to ArcGIS for Desktop applications by the ArcGIS Data Interoperability extension. It will cover the 6 common uses of the extension, including the added format support and how to author Extract Transform Load (ETL) workflows with the Spatial ETL Tool.
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
Під час доповіді відповімо на питання, навіщо потрібно підвищувати продуктивність аплікації і які є найефективніші способи для цього. А також поговоримо про те, що таке кеш, які його види бувають та, основне — як знайти performance bottleneck?
Відео та деталі заходу: https://bit.ly/45tILxj
"What does it really mean for your system to be available, or how to define w...
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
More Related Content
Similar to 2015 presentation
Geant4 physics validation on the GRID
Geant4 is the main simulation framework used for hight energy physics. It is used by the majority of the LHC experiments in CERN for detector simulation. Physics validation is a form of regression testing, that ensures that the produced simulation data do agree with previous versions of the framework and follow similar patterns with real data acquired from the experiments.
I developed a new system that is able to formulate the process of running Geant4 applications/tests on the LHC world-wide computing grid (WLCG), gather the results, stores them in relational database for indexing and object storage and provide them to the user through an intuitive web user-interface that can run on-demand small analysis tasks.
Reactive Documents and Computational Pipelines - Bridging the Gap
As scientific discovery and experimentation become increasingly reliant on computational methods, the static nature of traditional publications renders them progressively fragmented and unreproducible. How can workflow automation tools, such as Globus, be leveraged to address these issues and potentially create a new, higher-value form of publication? LivePublication leverages Globus’s custom Action Provider integrations and Compute nodes to capture semantic and provenance information during distributed flow executions. This information is then embedded within an RO-crate and interfaced with a programmatic document, creating a seamless pipeline from instruments, to computation, to publication.
MongoDB & The McGraw-Hill Education Learning Analytics Platform
Mark will discuss building a storage and processing platform which takes in data as students perform homework, quizzes and tests and stores it in a MongoDB database. The output are visualizations with allow students and teachers to track their progress in a class.
Introduction to SoapUI day 3
This document provides an introduction to working with different types of test steps in SOAPUI, including protocol-oriented test steps for SOAP and REST requests, flow control test steps, properties, data-oriented test steps using data sources and data sinks, and exercises for practicing with these step types. It covers creating and configuring REST projects using URIs, WADLs, and service discovery in SOAPUI.
Using Oracle Big Data Discovey as a Data Scientist's Toolkit
As delivered at Trivadis Tech Event 2016 - how Big Data Discovery along with Python and pySpark was used to build predictive analytics models against wearables and smart home data
MongoDB for Spatio-Behavioral Data Analysis and Visualization
T-Sciences offers iSpatial - a web-based Spatial Data Infrastructure (SDI) to enable integration of third-party applications with geo-visualization tools. The iHarvest tool further enables the mining and analysis of data aggregated in the iSpatial platform for spatio-temporal behavior modelling. At the back-end of both products is MongoDB, providing fundamental framework capabilities for the spatial indexing and data analysis techniques. Come witness how Thermopylae Sciences and Technology leveraged the aggregation framework, and extended the spatial capabilities of MongoDB to tackle dynamic spatio-behavioral data at scale.
Math-Bridge Architecture
The document describes the architecture of a math training program called Math-Bridge. It includes components like Apache Tomcat for web delivery, Maverick as a model-view-controller framework, and a core component for system functionality. Content is stored and indexed in a ContentDB using technologies like Java, Lucene and OMDoc. A learner model tracks user progress. Other components include presentation of content, user accounts, exercises that interface with a computer algebra system, and a tutorial component. The program uses technologies like Java, databases, XMLRPC and XSLT to power its functionality.
2019-04-17 Bio-IT World G Suite-Jira Cloud Sample Tracking
The document describes building a low-cost sample tracking system using G Suite and Jira Cloud. It discusses using current off-the-shelf technology to create a serverless solution, how low-cost solutions can accelerate academic research, and developing the minimum viable product through iterative delivery. Permission to learn new skills can help develop capabilities to address problems and move research forward.
GeoDataspace: Simplifying Data Management Tasks with Globus
This document describes GeoDataspace, a framework for enabling data and model sharing in computational geosciences. GeoDataspace uses geounits, which package code, data, and environment, to capture scientific activities and research outputs. The Globus Catalog provides a flexible metadata catalog for hosting and querying geounits. GeoDataspace aims to improve reproducibility and enable validation of shared models and data through re-executing geounits. Several geoscience applications including plate tectonics, hydrology, and space science are discussed as potential adopters.
Apache Spark sql
Spark SQL provides relational data processing capabilities in Spark. It introduces a DataFrame API that allows both relational operations on external data sources and Spark's built-in distributed collections. The Catalyst optimizer improves performance by applying database query optimization techniques. It is highly extensible, making it easy to add data sources, optimization rules, and data types for domains like machine learning. Spark SQL evaluation shows it outperforms alternative systems on both SQL query processing and Spark program workloads involving large datasets.
An AMIS Overview of Oracle database 12c (12.1)
Presentation used by Lucas Jellema and Marco Gralike during the AMIS Oracle Database 12c Launch event on Monday the 15th of July 2013 (much thanks to Tom Kyte, Oracle, for being allowed to use some of his material)
M.
Performance Testing your Kuali Student Product
Faced with two critical goals and low resources, the Kuali Student Test Team developed and implemented a test automation framework based on an open source tool ? Tsung and Amazon?s Elastic Compute Cloud (EC2). This automation framework netted success right away as it allowed the team to identify and regress critical performance issues through out development.
Kuali developers and test engineers, and technical staff from implementing institutions will learn how industry best practices for performance testing were applied to Kuali Student and will walk away with guidance on how to setup and run an open source performance testing tool to support their needs (live demonstration included).
An AMIS overview of database 12c
AMIS organiseerde op maandagavond 15 juli het seminar ‘Oracle database 12c revealed’. Deze avond bood AMIS Oracle professionals de eerste mogelijkheid om de vernieuwingen in Oracle database 12c in actie te zien! De AMIS specialisten die meer dan een jaar bèta testen hebben uitgevoerd lieten zien wat er nieuw is en hoe we dat de komende jaren gaan inzetten!
Deze presentatie is deze avond gegeven als een plenaire sessie!
Functional Testing of RESTful Applications
This document discusses tools and techniques for functional testing of RESTful applications. It covers different levels of testing from unit to system level. It then describes using blackbox testing as a monitoring tool by generating test data, overcoming latency, and integrating with monitoring services. Graybox testing is discussed as a way to control external dependencies through mocking services. Finally, it recommends using Cucumber to develop business-focused test scenarios that are closer to documentation and easier to maintain.
QA Team Goes to Agile and Continuous integration
The document discusses how the QA team has transitioned to using agile and continuous integration methodologies to improve testing processes. It outlines several strategies for test automation, including using frameworks that break testing into reusable components and actions to increase efficiency and allow for parallel testing. The goal is to eliminate friction between developers and testers by enabling quick fixing of bugs and continued testing through virtual test data sharing.
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
1) Globus Genomics addresses challenges in sequencing analysis by providing a platform that integrates data transfer via Globus Online, workflow management in Galaxy, and scalable compute resources in AWS.
2) An example collaboration with the Dobyns Lab saw over a 10x speedup in exome data analysis by replacing a manual process with Globus Genomics.
3) Globus Genomics leverages XSEDE services like Globus Transfer and Nexus while integrating additional resources like sequencing centers and cloud computing, in order to reduce the costs and complexities of genomic research for communities not traditionally using advanced cyberinfrastructure.
Quick Test Professional (QTP/UFT)
In this quality assurance training session, you will learn QTP/UFT automation testing. Topics covered in this course are:
• Introduction to QTP
• Features of QTP
• Recording modes of QTP
• Object Repository
• Synchronization point
• Step Generator
• Object Spy
• Checkpoints
• Data-driven testing & Parameterization
• Working with actions
• Reporting in QTP
TO know more, visit this link: https://www.mindsmapped.com/courses/quality-assurance/get-practical-training-on-software-testing-quality-assurance-qa/
Globus Automation
We introduce the various Globus approaches available for automating data flows, including the command line interface (CLI), the Globus Timer service and the Globus Flows service.
Soap UI - Lesson3
This document provides an introduction and overview of various testing capabilities in SOAPUI, including:
- Protocol-oriented test steps for SOAP, REST, and JDBC requests
- Flow control test steps like properties, delays, scripts, and manual steps
- Using properties to transfer data between requests
- Adding assertions to validate test results
- Delay steps to control test flow timing
- Manual test steps to add human validation
- Data-oriented test steps for using data sources, loops, sinks, and generators
It includes exercises for hands-on practice with many of these features.
Data Interoperability Basics - Esri UC 2015
This session will focus on the functionality added to ArcGIS for Desktop applications by the ArcGIS Data Interoperability extension. It will cover the 6 common uses of the extension, including the added format support and how to author Extract Transform Load (ETL) workflows with the Spatial ETL Tool.
Similar to 2015 presentation (20)
Reactive Documents and Computational Pipelines - Bridging the Gap
Reactive Documents and Computational Pipelines - Bridging the Gap
MongoDB & The McGraw-Hill Education Learning Analytics Platform
MongoDB & The McGraw-Hill Education Learning Analytics Platform
Using Oracle Big Data Discovey as a Data Scientist's Toolkit
Using Oracle Big Data Discovey as a Data Scientist's Toolkit
MongoDB for Spatio-Behavioral Data Analysis and Visualization
MongoDB for Spatio-Behavioral Data Analysis and Visualization
2019-04-17 Bio-IT World G Suite-Jira Cloud Sample Tracking
2019-04-17 Bio-IT World G Suite-Jira Cloud Sample Tracking
GeoDataspace: Simplifying Data Management Tasks with Globus
GeoDataspace: Simplifying Data Management Tasks with Globus
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
Recently uploaded
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
Під час доповіді відповімо на питання, навіщо потрібно підвищувати продуктивність аплікації і які є найефективніші способи для цього. А також поговоримо про те, що таке кеш, які його види бувають та, основне — як знайти performance bottleneck?
Відео та деталі заходу: https://bit.ly/45tILxj
"What does it really mean for your system to be available, or how to define w...
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
Dandelion Hashtable: beyond billion requests per second on a commodity server
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
From Natural Language to Structured Solr Queries using LLMs
This talk draws on experimentation to enable AI applications with Solr. One important use case is to use AI for better accessibility and discoverability of the data: while User eXperience techniques, lexical search improvements, and data harmonization can take organizations to a good level of accessibility, a structural (or “cognitive” gap) remains between the data user needs and the data producer constraints.
That is where AI – and most importantly, Natural Language Processing and Large Language Model techniques – could make a difference. This natural language, conversational engine could facilitate access and usage of the data leveraging the semantics of any data source.
The objective of the presentation is to propose a technical approach and a way forward to achieve this goal.
The key concept is to enable users to express their search queries in natural language, which the LLM then enriches, interprets, and translates into structured queries based on the Solr index’s metadata.
This approach leverages the LLM’s ability to understand the nuances of natural language and the structure of documents within Apache Solr.
The LLM acts as an intermediary agent, offering a transparent experience to users automatically and potentially uncovering relevant documents that conventional search methods might overlook. The presentation will include the results of this experimental work, lessons learned, best practices, and the scope of future work that should improve the approach and make it production-ready.
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops Opensource Database Meetup 16
Topic: Must-Know PostgreSQL Extensions for Developers and DBAs During Migration
Speaker: Deepak Mahto, Founder of DataCloudGaze Consulting
Date & Time: 8th June | 10 AM - 1 PM IST
Venue: Bangalore International Centre, Bangalore
Abstract: Discover how PostgreSQL extensions can be your secret weapon! This talk explores how key extensions enhance database capabilities and streamline the migration process for users moving from other relational databases like Oracle.
Key Takeaways:
* Learn about crucial extensions like oracle_fdw, pgtt, and pg_audit that ease migration complexities.
* Gain valuable strategies for implementing these extensions in PostgreSQL to achieve license freedom.
* Discover how these key extensions can empower both developers and DBAs during the migration process.
* Don't miss this chance to gain practical knowledge from an industry expert and stay updated on the latest open-source database trends.
Mydbops Managed Services specializes in taking the pain out of database management while optimizing performance. Since 2015, we have been providing top-notch support and assistance for the top three open-source databases: MySQL, MongoDB, and PostgreSQL.
Our team offers a wide range of services, including assistance, support, consulting, 24/7 operations, and expertise in all relevant technologies. We help organizations improve their database's performance, scalability, efficiency, and availability.
Contact us: info@mydbops.com
Visit: https://www.mydbops.com/
Follow us on LinkedIn: https://in.linkedin.com/company/mydbops
For more details and updates, please follow up the below links.
Meetup Page : https://www.meetup.com/mydbops-databa...
Twitter: https://twitter.com/mydbopsofficial
Blogs: https://www.mydbops.com/blog/
Facebook(Meta): https://www.facebook.com/mydbops/
Northern Engraving | Nameplate Manufacturing Process - 2024
Manufacturing custom quality metal nameplates and badges involves several standard operations. Processes include sheet prep, lithography, screening, coating, punch press and inspection. All decoration is completed in the flat sheet with adhesive and tooling operations following. The possibilities for creating unique durable nameplates are endless. How will you create your brand identity? We can help!
A Deep Dive into ScyllaDB's Architecture
This talk will cover ScyllaDB Architecture from the cluster-level view and zoom in on data distribution and internal node architecture. In the process, we will learn the secret sauce used to get ScyllaDB's high availability and superior performance. We will also touch on the upcoming changes to ScyllaDB architecture, moving to strongly consistent metadata and tablets.
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
This is a session that details how PostgreSQL's features and Azure AI Services can be effectively used to significantly enhance the search functionality in any application.
In this session, we'll share insights on how we used PostgreSQL to facilitate precise searches across multiple fields in our mobile application. The techniques include using LIKE and ILIKE operators and integrating a trigram-based search to handle potential misspellings, thereby increasing the search accuracy.
We'll also discuss how the azure_ai extension on PostgreSQL databases in Azure and Azure AI Services were utilized to create vectors from user input, a feature beneficial when users wish to find specific items based on text prompts. While our application's case study involves a drug search, the techniques and principles shared in this session can be adapted to improve search functionality in a wide range of applications. Join us to learn how PostgreSQL and Azure AI can be harnessed to enhance your application's search capability.
What is an RPA CoE? Session 2 – CoE Roles
In this session, we will review the players involved in the CoE and how each role impacts opportunities.
Topics covered:
• What roles are essential?
• What place in the automation journey does each role play?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
These are the slides for the presentation, "Component Testing: Bridging the gap between frontend applications" that was presented at QA or the Highway 2024 in Columbus, OH by Zachary Hamm.
AWS Certified Solutions Architect Associate (SAA-C03)
AWS Certified Solutions Architect Associate (SAA-C03)
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
ScyllaDB monitoring provides a lot of useful information. But sometimes it’s not easy to find the root of the problem if something is wrong or even estimate the remaining capacity by the load on the cluster. This talk shares our team's practical tips on: 1) How to find the root of the problem by metrics if ScyllaDB is slow 2) How to interpret the load and plan capacity for the future 3) Compaction strategies and how to choose the right one 4) Important metrics which aren’t available in the default monitoring setup.
JavaLand 2024: Application Development Green Masterplan
My presentation slides I used at JavaLand 2024
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
GNSS spoofing via SDR (Criptored Talks 2024)
In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security.
This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing.
The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Gursev Pirge, PhD
Senior Data Scientist - JohnSnowLabs
Apps Break Data
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
Containers & AI - Beauty and the Beast!?!
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Keywords: AI, Containeres, Kubernetes, Cloud Native
Event Link: https://meine.doag.org/events/cloudland/2024/agenda/#agendaId.4211
Recently uploaded (20)
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
GlobalLogic Java Community Webinar #18 “How to Improve Web Application Perfor...
"What does it really mean for your system to be available, or how to define w...
"What does it really mean for your system to be available, or how to define w...
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
From Natural Language to Structured Solr Queries using LLMs
From Natural Language to Structured Solr Queries using LLMs
Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
AWS Certified Solutions Architect Associate (SAA-C03)
AWS Certified Solutions Architect Associate (SAA-C03)
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
2015 presentation
- 1. Summer 2015 Project Nikhil Ghosh Stanford University Physics Department Kasevich Group 1
- 2. Database Front-End Current State • Allows users to query the lab database and select results from a time period • Semi-automated uploading of lab results to database • Rudimentary webpage which allows for calling of data from specified locations in the database • Criteria such as time-frame, qualities 2
- 3. Additions • Graphability— uses GWT prefab plots • Event tracking and data association (Google Calendar API) 3
- 4. Graphability • Uses charts4j port from Google Web Toolkit • Uses JDBC (Java Database Connectivity) • Client-side code can talk to DB in SQL • Assign specific values from a selected column • Correspond to a graphable data point 4
- 5. Example graph showing temp vs time (recorded per data entry, automation possible) 5
- 6. Event tracking • Calendar format, stores manually recorded events (observations, notes, irregularities) • Link between calendar event date and DB data entry dates • Select events returned when data pulled from specific timeframe • Event can be single or timespan 6
- 7. Example calendar— multi use, simple interface Google Calendar API 7
- 8. Things I Learned • Java, JS, and Python tutorials • Basics of relational algebra and databases • Practice using SQL and JDBC • Gained familiarity with Google Web Toolkit • Learned how to use the Google Calendar API 8
- 9. Next steps + ideas • Improved security for calling/editing permissions of event logger • Graphing expansion— multiple variables vs time • Data analytics features? Classification and cataloguing of data • Automated event data uploads (temp, moon cycle, device maintenance) 9
- 10. Thank You! • Prof. Mark Kasevich • Prof. Jason Hogan • The Kasevich Group (Raj, Brannon, Nils, et. al) 10