Poing: a coder’s take on protein modelling
•
1 like•775 views
Poing is a protein structure and folding model, designed to predict the tertiary structure of a protein from its sequence. I’ve been developing Poing for five years, after moving into computational biology from a background in software engineering. I’ve tried to keep the engineering ethos whilst dealing with the vagaries of scientific enquiry. My talk will focus on the engineering aspect, and how I’ve used a combination of C++, Python, various Python libraries, Subversion and server farms to produce a fairly slick workflow for both software engineering and developing and using the protein structure model. I will also talk about what I would have done differently with the benefit of hindsight.
Report
Share
Report
Share
![poing a coder's take on protein modelling Benjamin Jefferys Imperial College London [email_address]](https://image.slidesharecdn.com/poingforpublic-110227170953-phpapp01/85/Poing-a-coder-s-take-on-protein-modelling-1-320.jpg)
![Talk overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Building an open source python application the right way
The document provides guidelines for building an open source Python application the right way. It recommends following best practices and conventions to make the code easy to use by others. The key aspects covered are: writing good code and tests, using documentation and modules, managing dependencies, setting up virtual environments, publishing to PyPI, and automating tasks with Makefiles. Additional recommendations include adding AUTHORS, CHANGELOG, CONTRIBUTING and license files. The goal is to structure the project properly and follow open source conventions to encourage contributions from others.
Roundup presentation
This document summarizes the author's experiences at a week-long "Geek Sleep-away Camp" for programmers. Some of the key things the author learned include:
- They built a basic CRUD web application using a Java/Scala framework called Play in just a few hours.
- Heroku is a cloud platform that makes deploying applications easy.
- NoSQL databases like Neo4j's graph databases can be useful for certain types of data and queries.
- Tools like JRebel, HipChat, and Camscanner Plus were demonstrated for improving productivity.
- Presentations were in an "open space" format with discussions rather than traditional lectures.
Performance Enhancement Tips
This document provides performance enhancement tips for Python programs. It recommends profiling code first using the "python -m cProfile" command to identify slow parts before optimizing. Potential optimization strategies discussed include using PyPy to gain a 2x page load speed boost, using Cython to compile Python to C for a 20% performance boost with no code changes, and using multiprocessing to parallelize CPU-bound tasks by utilizing all CPU cores. Multiprocessing is preferable to multithreading in Python due to the Global Interpreter Lock (GIL). The document emphasizes profiling first and reducing complexity over premature optimization.
Recipes for successful CakePHP projects
Slides from the talk given by Felix Geisendörfer during the CakeFest #3 - July 2009
Note: the original pdf can be found on cakephp.org
The Perfect Neos Project Setup
There are many ways to start a new Neos-based project and there is a multitude of tools involved. These slides introduce a "perfect" way to set up a Neos project. A recording of the presentation is available at https://youtu.be/hWJSK0pE1H0
Why Your Selenium Tests are so Dang Brittle, and What to Do About It
This document discusses strategies for making Selenium web application GUI tests less brittle. It recommends writing fewer GUI tests and more unit and integration tests. For the GUI tests that are written, it suggests hand coding the tests in Java rather than recording and playback, using object oriented design principles, keeping test framework code dry while allowing test code to be wetter, and using element locators like ID attributes and xpath as a last resort. The document then provides examples of code that implements these strategies.
The Art of Evolutionary Algorithms Programming
Tutorial at http://cec2011.org on how to be more efficient writing more efficient programs that streamlines experiments and publication of results
Put to the Test
This document discusses refactoring code through careful modifications that do not change functionality. It emphasizes that refactoring requires rigorous unit testing to be done correctly. Successful refactoring can be achieved through uninterrupted work, pair programming, or test-driven development with an automated testing framework. Tests should be written early and often to catch errors introduced during refactoring. The minimum requirement for testing is assert statements, which provide an easy way to start testing without complex tools. Overall, the document stresses that refactoring is best approached as a disciplined process guided by thorough automated testing.
Recommended
Building an open source python application the right way
The document provides guidelines for building an open source Python application the right way. It recommends following best practices and conventions to make the code easy to use by others. The key aspects covered are: writing good code and tests, using documentation and modules, managing dependencies, setting up virtual environments, publishing to PyPI, and automating tasks with Makefiles. Additional recommendations include adding AUTHORS, CHANGELOG, CONTRIBUTING and license files. The goal is to structure the project properly and follow open source conventions to encourage contributions from others.
Roundup presentation
This document summarizes the author's experiences at a week-long "Geek Sleep-away Camp" for programmers. Some of the key things the author learned include:
- They built a basic CRUD web application using a Java/Scala framework called Play in just a few hours.
- Heroku is a cloud platform that makes deploying applications easy.
- NoSQL databases like Neo4j's graph databases can be useful for certain types of data and queries.
- Tools like JRebel, HipChat, and Camscanner Plus were demonstrated for improving productivity.
- Presentations were in an "open space" format with discussions rather than traditional lectures.
Performance Enhancement Tips
This document provides performance enhancement tips for Python programs. It recommends profiling code first using the "python -m cProfile" command to identify slow parts before optimizing. Potential optimization strategies discussed include using PyPy to gain a 2x page load speed boost, using Cython to compile Python to C for a 20% performance boost with no code changes, and using multiprocessing to parallelize CPU-bound tasks by utilizing all CPU cores. Multiprocessing is preferable to multithreading in Python due to the Global Interpreter Lock (GIL). The document emphasizes profiling first and reducing complexity over premature optimization.
Recipes for successful CakePHP projects
Slides from the talk given by Felix Geisendörfer during the CakeFest #3 - July 2009
Note: the original pdf can be found on cakephp.org
The Perfect Neos Project Setup
There are many ways to start a new Neos-based project and there is a multitude of tools involved. These slides introduce a "perfect" way to set up a Neos project. A recording of the presentation is available at https://youtu.be/hWJSK0pE1H0
Why Your Selenium Tests are so Dang Brittle, and What to Do About It
This document discusses strategies for making Selenium web application GUI tests less brittle. It recommends writing fewer GUI tests and more unit and integration tests. For the GUI tests that are written, it suggests hand coding the tests in Java rather than recording and playback, using object oriented design principles, keeping test framework code dry while allowing test code to be wetter, and using element locators like ID attributes and xpath as a last resort. The document then provides examples of code that implements these strategies.
The Art of Evolutionary Algorithms Programming
Tutorial at http://cec2011.org on how to be more efficient writing more efficient programs that streamlines experiments and publication of results
Put to the Test
This document discusses refactoring code through careful modifications that do not change functionality. It emphasizes that refactoring requires rigorous unit testing to be done correctly. Successful refactoring can be achieved through uninterrupted work, pair programming, or test-driven development with an automated testing framework. Tests should be written early and often to catch errors introduced during refactoring. The minimum requirement for testing is assert statements, which provide an easy way to start testing without complex tools. Overall, the document stresses that refactoring is best approached as a disciplined process guided by thorough automated testing.
Perl cures coronary heart disease
Life sciences in general such as genetics and biology have traditionally benefited from Perl with excellent projects leading the way such as BioPerl. Unfortunately, in medical research and epidemiology, the picture is different. Researchers are struggling with the ever increasing size and complexity of datasets. This presentation will briefly describe the situation I faced when I first joined a research team working on coronary heart disease, what I did to make things better and how I achieved one small victory for Perl.
Quién es maría montessori
María Montessori fue una educadora italiana que desarrolló un método de enseñanza basado en la observación de los niños. Fundó la Casa de los Niños donde aplicó su método, dando a los niños libertad y materiales didácticos para que aprendieran por sí mismos. Su método se centra en el desarrollo de la independencia de los niños a través de actividades prácticas y manipulativas en un ambiente preparado específicamente para ello.
Disrupting the Customers Journey: Gartner Customer 360 Summit 09092015
Who really owns the customer experience? High level overview of LinkedIn, What customers' expect, our Member First and differentiating culture that helps LinkedIn's 380M+ Members and Customers get the most out of their journey as we connect them with opportunity
DASbrick: A cloud based Rich internet application for Synthetic Biology Parts...
N Purswani, L. Tweedy, Z. Patel, C.Suriel-Melchor – DASbrick: A cloud based Rich internet application for Synthetic Biology Parts Registries.
Biobricks are an important standard in the emerging field of synthetic biology. These standardised genetic parts are essentially lego for geneticists (or at least the ones who don’t play with actual lego). They allow for an easy, modular approach to genetic engineering and their component-like nature is a valuable starting point for the computer aided design of complete genetic systems.
Such tools rely on informatics tool and a well-kept database is vital. The current repository for biobrick information is at MIT, and has been around since the inception of the idea. As such, it contains parts of multiple standards, and the quality of their annotation is extremely variable. There is a need for alternative tools, and DASBrick, a client-server system employing the widely used Distributed Annotation System, aims to address this need.
Curriculum vitate - Ankit Kumar Jain
Ankit Kumar Jain is a commerce graduate and semi-qualified chartered accountant who has cleared the first group of CA finals. He has over 3 years of work experience in statutory audit, internal audit, tax audit, and other areas through his articleship training. He is seeking a career opportunity in an organization where he can utilize his skills and expertise in auditing, accounting, taxation, and finance. He believes his academic qualifications and work experience would allow him to make a meaningful contribution. He has included his resume for consideration.
Mastery journey timeline presentation
The document outlines a 12-course master's program in game design. The program covers topics such as personal development, team dynamics, project management, game design, user experience design, production tools, prototyping, quality assurance, asset management, usability testing, and a capstone research project. Each course includes expected learning outcomes and a suggested online tutorial for additional learning. Upon completing the program, students will have a polished portfolio and skills to work as a game designer. The document also lists industry mentors, organizations, companies and a framework for conducting further research.
Enterprise Gamification Taxonomy
This is a presentation I made at DiGRA 2015 in Luneburg Germany on my published research paper. The full paper can be found here:
https://rmit.academia.edu/MarigoRaftopoulos
CAIC Prof. Mariano Costa
The document discusses Festa Julina 2016, which was an event hosted by CAIC. Festa Julina is an annual Brazilian celebration that occurs in July, featuring traditional food, music, and dancing. CAIC's 2016 Festa Julina event allowed attendees to experience the rich culture and traditions of Brazil through authentic cuisine, live performances, and family-friendly activities.
2015-12-07 Matematica felice a 4-5 anni
Un depliant che presenta l' offerta formativa di Impariamo a imparare per la matematica felice nella scuola dell' infanzia
ANÁLISIS DE UN NOVELA: La tía julia y el escribidor.
Este documento analiza la novela "La tía Julia y el escribidor" de Mario Vargas Llosa. Resume los principales puntos del análisis como los personajes, la trama, el ambiente y la estructura de la novela. También describe brevemente los elementos técnicos como el punto de vista y estilo narrativo utilizados por el autor.
Operations Strategy-A Literature Review
This document provides a literature review on operations strategy. It discusses four main points: 1) There are multiple accepted methods for developing an operations strategy, including top-down, bottom-up, and integrated approaches. 2) There is more literature on the content of operations strategies than the process. 3) Linking corporate and operations strategies improves company performance. 4) Recent research and a changing business environment have increased the importance of operations strategy for organizations.
Why I Love Python
The document discusses why the author loves Python programming language. Some key reasons include:
1. Python allows the author to focus on concepts rather than fighting with compiler bugs or syntax issues found in other languages.
2. Python code is more readable and compact due to consistent formatting and use of idioms, allowing for rapid understanding.
3. The author finds Python more productive than other languages due to reduced typing and not having to wade through as much code.
Better Functional Design through TDD
The document discusses how test-driven development (TDD) can lead to better functional design. It explains that TDD focuses on defining requirements before implementation, limits test and code scope to reduce complexity, and makes dependencies explicit upfront. This helps produce code that is loosely coupled, simple to understand and maintain, and easy to test. The document recommends starting with examples or tests, keeping components small with single responsibilities, and designing dependent parts first.
Agile analysis development
This document describes the development of an agile analysis pipeline for processing next generation DNA sequencing data. The pipeline was developed iteratively using short 2-3 week iterations. Early iterations involved replacing sections of the pipeline with new pluggable components. Later iterations focused on refactoring the code and adding new features like automated quality control checks. A key iteration involved quickly fixing the pipeline when new analysis code introduced bugs. The agile development approach helped allow the priority to change to the critical fix and incorporate it with minimal disruption.
PHP to Python with No Regrets
This document summarizes a company's transition from a PHP codebase to Python. It discusses why they made the change, how they approached it incrementally instead of a full rewrite, and what they learned from the process. Key points include adopting Django and SQLAlchemy, improving testing, and maintaining the existing PHP session handling. The transition faced challenges but increased developer productivity and the ability to add new features more quickly. Overall the experience reinforced the benefits of Python for their needs.
2014 manchester-reproducibility
This document discusses computational reproducibility challenges in analyzing non-model organism sequencing data. It describes how shotgun sequencing is used to assemble genomes and transcriptomes and measure gene expression without a reference genome. K-mers are introduced as an implicit alignment method using overlapping fragments. Efficient data structures and algorithms are needed to analyze the large amounts of redundant sequencing data while retaining information. The author's lab approach is to develop novel methods at scale and apply them to real problems, then release everything openly online to enable reproducibility.
Lean engineering for lean/balanced teams: lessons learned (and still learning...
Bill Scott discusses lessons learned bringing lean principles to engineering at PayPal. Some key points:
1. PayPal moved from a culture of long delivery cycles to prioritizing rapid experimentation and learning from customer feedback.
2. The company established two-pizza teams, used Git for continuous deployment, and made the prototype and production stacks the same to enable fast iteration.
3. Principles for lean engineering include refactoring to support experimentation, designing for volatility, decentralizing work, and establishing a "brain" to guide agile work based on customer needs.
PHP Mega Meetup, Sep, 2020, Anti patterns in php
PHP is one of the easiest programming languages to use ever and powers more than half of the internet.
With this ease of use, certain common patterns emerge that become harmful. This is especially true when your product or service is not expected to die soon. Some anti-patterns are coding, others are related to operating your service, especially with new docker stacks. We will go over some of the most common pitfalls with a focus on enterprise development.
More Related Content
Viewers also liked
Perl cures coronary heart disease
Life sciences in general such as genetics and biology have traditionally benefited from Perl with excellent projects leading the way such as BioPerl. Unfortunately, in medical research and epidemiology, the picture is different. Researchers are struggling with the ever increasing size and complexity of datasets. This presentation will briefly describe the situation I faced when I first joined a research team working on coronary heart disease, what I did to make things better and how I achieved one small victory for Perl.
Quién es maría montessori
María Montessori fue una educadora italiana que desarrolló un método de enseñanza basado en la observación de los niños. Fundó la Casa de los Niños donde aplicó su método, dando a los niños libertad y materiales didácticos para que aprendieran por sí mismos. Su método se centra en el desarrollo de la independencia de los niños a través de actividades prácticas y manipulativas en un ambiente preparado específicamente para ello.
Disrupting the Customers Journey: Gartner Customer 360 Summit 09092015
Who really owns the customer experience? High level overview of LinkedIn, What customers' expect, our Member First and differentiating culture that helps LinkedIn's 380M+ Members and Customers get the most out of their journey as we connect them with opportunity
DASbrick: A cloud based Rich internet application for Synthetic Biology Parts...
N Purswani, L. Tweedy, Z. Patel, C.Suriel-Melchor – DASbrick: A cloud based Rich internet application for Synthetic Biology Parts Registries.
Biobricks are an important standard in the emerging field of synthetic biology. These standardised genetic parts are essentially lego for geneticists (or at least the ones who don’t play with actual lego). They allow for an easy, modular approach to genetic engineering and their component-like nature is a valuable starting point for the computer aided design of complete genetic systems.
Such tools rely on informatics tool and a well-kept database is vital. The current repository for biobrick information is at MIT, and has been around since the inception of the idea. As such, it contains parts of multiple standards, and the quality of their annotation is extremely variable. There is a need for alternative tools, and DASBrick, a client-server system employing the widely used Distributed Annotation System, aims to address this need.
Curriculum vitate - Ankit Kumar Jain
Ankit Kumar Jain is a commerce graduate and semi-qualified chartered accountant who has cleared the first group of CA finals. He has over 3 years of work experience in statutory audit, internal audit, tax audit, and other areas through his articleship training. He is seeking a career opportunity in an organization where he can utilize his skills and expertise in auditing, accounting, taxation, and finance. He believes his academic qualifications and work experience would allow him to make a meaningful contribution. He has included his resume for consideration.
Mastery journey timeline presentation
The document outlines a 12-course master's program in game design. The program covers topics such as personal development, team dynamics, project management, game design, user experience design, production tools, prototyping, quality assurance, asset management, usability testing, and a capstone research project. Each course includes expected learning outcomes and a suggested online tutorial for additional learning. Upon completing the program, students will have a polished portfolio and skills to work as a game designer. The document also lists industry mentors, organizations, companies and a framework for conducting further research.
Enterprise Gamification Taxonomy
This is a presentation I made at DiGRA 2015 in Luneburg Germany on my published research paper. The full paper can be found here:
https://rmit.academia.edu/MarigoRaftopoulos
CAIC Prof. Mariano Costa
The document discusses Festa Julina 2016, which was an event hosted by CAIC. Festa Julina is an annual Brazilian celebration that occurs in July, featuring traditional food, music, and dancing. CAIC's 2016 Festa Julina event allowed attendees to experience the rich culture and traditions of Brazil through authentic cuisine, live performances, and family-friendly activities.
2015-12-07 Matematica felice a 4-5 anni
Un depliant che presenta l' offerta formativa di Impariamo a imparare per la matematica felice nella scuola dell' infanzia
ANÁLISIS DE UN NOVELA: La tía julia y el escribidor.
Este documento analiza la novela "La tía Julia y el escribidor" de Mario Vargas Llosa. Resume los principales puntos del análisis como los personajes, la trama, el ambiente y la estructura de la novela. También describe brevemente los elementos técnicos como el punto de vista y estilo narrativo utilizados por el autor.
Operations Strategy-A Literature Review
This document provides a literature review on operations strategy. It discusses four main points: 1) There are multiple accepted methods for developing an operations strategy, including top-down, bottom-up, and integrated approaches. 2) There is more literature on the content of operations strategies than the process. 3) Linking corporate and operations strategies improves company performance. 4) Recent research and a changing business environment have increased the importance of operations strategy for organizations.
Viewers also liked (15)
Disrupting the Customers Journey: Gartner Customer 360 Summit 09092015
Disrupting the Customers Journey: Gartner Customer 360 Summit 09092015
DASbrick: A cloud based Rich internet application for Synthetic Biology Parts...
DASbrick: A cloud based Rich internet application for Synthetic Biology Parts...
ANÁLISIS DE UN NOVELA: La tía julia y el escribidor.
ANÁLISIS DE UN NOVELA: La tía julia y el escribidor.
Similar to Poing: a coder’s take on protein modelling
Why I Love Python
The document discusses why the author loves Python programming language. Some key reasons include:
1. Python allows the author to focus on concepts rather than fighting with compiler bugs or syntax issues found in other languages.
2. Python code is more readable and compact due to consistent formatting and use of idioms, allowing for rapid understanding.
3. The author finds Python more productive than other languages due to reduced typing and not having to wade through as much code.
Better Functional Design through TDD
The document discusses how test-driven development (TDD) can lead to better functional design. It explains that TDD focuses on defining requirements before implementation, limits test and code scope to reduce complexity, and makes dependencies explicit upfront. This helps produce code that is loosely coupled, simple to understand and maintain, and easy to test. The document recommends starting with examples or tests, keeping components small with single responsibilities, and designing dependent parts first.
Agile analysis development
This document describes the development of an agile analysis pipeline for processing next generation DNA sequencing data. The pipeline was developed iteratively using short 2-3 week iterations. Early iterations involved replacing sections of the pipeline with new pluggable components. Later iterations focused on refactoring the code and adding new features like automated quality control checks. A key iteration involved quickly fixing the pipeline when new analysis code introduced bugs. The agile development approach helped allow the priority to change to the critical fix and incorporate it with minimal disruption.
PHP to Python with No Regrets
This document summarizes a company's transition from a PHP codebase to Python. It discusses why they made the change, how they approached it incrementally instead of a full rewrite, and what they learned from the process. Key points include adopting Django and SQLAlchemy, improving testing, and maintaining the existing PHP session handling. The transition faced challenges but increased developer productivity and the ability to add new features more quickly. Overall the experience reinforced the benefits of Python for their needs.
2014 manchester-reproducibility
This document discusses computational reproducibility challenges in analyzing non-model organism sequencing data. It describes how shotgun sequencing is used to assemble genomes and transcriptomes and measure gene expression without a reference genome. K-mers are introduced as an implicit alignment method using overlapping fragments. Efficient data structures and algorithms are needed to analyze the large amounts of redundant sequencing data while retaining information. The author's lab approach is to develop novel methods at scale and apply them to real problems, then release everything openly online to enable reproducibility.
Lean engineering for lean/balanced teams: lessons learned (and still learning...
Bill Scott discusses lessons learned bringing lean principles to engineering at PayPal. Some key points:
1. PayPal moved from a culture of long delivery cycles to prioritizing rapid experimentation and learning from customer feedback.
2. The company established two-pizza teams, used Git for continuous deployment, and made the prototype and production stacks the same to enable fast iteration.
3. Principles for lean engineering include refactoring to support experimentation, designing for volatility, decentralizing work, and establishing a "brain" to guide agile work based on customer needs.
PHP Mega Meetup, Sep, 2020, Anti patterns in php
PHP is one of the easiest programming languages to use ever and powers more than half of the internet.
With this ease of use, certain common patterns emerge that become harmful. This is especially true when your product or service is not expected to die soon. Some anti-patterns are coding, others are related to operating your service, especially with new docker stacks. We will go over some of the most common pitfalls with a focus on enterprise development.
Euro python2011 High Performance Python
I ran this as a 4 hour tutorial at EuroPython 2011 to teach High Performance Python coding.
Techniques covered include bottleneck analysis by profiling, bytecode analysis, converting to C using Cython and ShedSkin, use of the numerical numpy library and numexpr, multi-core and multi-machine parallelisation and using CUDA GPUs.
Write-up with 49 page PDF report: http://ianozsvald.com/2011/06/29/high-performance-python-tutorial-v0-1-from-my-4-hour-tutorial-at-europython-2011/
Checking the Source SDK Project
The Source SDK is a software development kit compiled by Valve Corporation that is used to create games or mods for the Source engine. I downloaded and checked the project's source codes at the end of 2013 already and intended to write an article about it during the New Year holidays. But laziness prevailed over the craving for creativity, and I sat down to writing the article only on getting back to work. However, I doubt that the source codes have changed during this time. Now you are welcome to have a look at the suspicious code fragments found in the project code by the PVS-Studio code analyzer.
What does OOP stand for?
What does OOP stand for?
When Object Oriented Programming(OOP) is taught so extensively, do computer programmers, specifically within games development, realise what it's possibly doing to productivity and performance? I explain my own view from experience in personal projects and professional work.
This talk was given to the Edinburgh meet of IGDA Scotland, on 2011/07/27.
Why I Love Python V2
This document discusses why the author loves Python. In 3 sentences:
The author loves Python because it allows them to focus on concepts rather than syntax or performance. Python reduces clutter and makes the author more productive by avoiding unnecessary complexity. The clean design of Python encourages clean library design and idioms that are simple for the author to remember.
Performance and optimization CakeFest 2014
This document provides guidelines and techniques for profiling and optimizing performance. It recommends measuring performance metrics, prioritizing front-end optimizations like reducing file sizes and HTTP requests before backend optimizations, and optimizing code last after other techniques. Specific techniques discussed include minifying assets, compressing images, adding caching, using developer tools to identify issues, and PHP profiling tools like XHProf and XDebug.
Scratching the itch, making Scratch for the Raspberry Pie
Title: Scratching the itch, making Scratch for the Raspberry Pie
Speaker: Tim Rowledge
Fri, August 22, 12:00pm – 12:30pm
Abstract: Scratch was originally written in a Squeak 2.8 era image. Much has changed since then and to make the Raspberry Pi run Scratch as well as possible we have ported the code forward to a 4.5 image so it can run on a StackVM; and soon a Cog VM. A substantial amount of Smalltalk code has had to be rewritten to do this and yet we have to maintain complete compatibility with the original system to avoid overloading the teachers that use it in their classes. A new branch of Cog for the ARM cpu is being written as well.
Bio: Tim Rowledge has almost 30 years of Smalltalk experience, and almost as much with ARM. Somehow the two have always gone together.
2014 nicta-reproducibility
This document discusses openness and reproducibility in computational science. It begins with an introduction and background on the challenges of analyzing non-model organisms. It then describes the goals and challenges of shotgun sequencing analysis, including assembly, counting, and variant calling. It emphasizes the need for efficient data structures, algorithms, and cloud-based analysis to handle large datasets. The document advocates for open science practices like publishing code, data, and analyses to ensure reproducibility of computational results.
Do Your Homework! Writing tests for Data Science and Stochastic Code - David ...
To productionize data science work (and have it taken seriously by software engineers, CTOs, clients, or the open source community), you need to write tests! Except… how can you test code that performs nondeterministic tasks like natural language parsing and modeling? This talk presents an approach to testing probabilistic functions in code, illustrated with concrete examples written for Pytest.
Ui Testing with Ghost Inspector
Jay Luker will be presenting an introduction to Ghost Inspector, a cloud-based web UI testing service that takes some (some!) of the pain away from creating browser-based, web application tests. Think Selenium, but for projects that are short on the resources, infrastructure and/or coding expertise to confidently develop and manage a suite of fully automated, “good-enough” UI tests.
Jay is a Senior Software Engineer at Harvard DCE where he works on back-end applications and software for analytics data collection, deployment automation, and integration testing for the Extension School’s video processing and delivery system. Previously he has been an IT Specialist at the Smithsonian Astrophysics Data System, and a Software Developer at Ex Libris.
Doing the Impossible
If someone tells you that it is impossible to reimplement some piece of software to be compatible with a newer technology, that is most often not truth.
This is the story about porting RestrictedPython, one of the core packages of Zope to be compatible with Python 3.
Confoo 2024 Gettings started with OpenAI and data science
The document provides steps for getting started with using AI to assist with data science work. It outlines 5 steps: 1) Find a large language model (LLM) that can be installed in your integrated development environment (IDE), 2) Install the extension or library for the LLM in your IDE, 3) Try a simple "hello world" type command to test it, 4) Evaluate the code suggested by the AI, and 5) Continue practicing and exploring with the help of the AI. The document uses setting up Jupyter notebooks with the OpenAI LLM as a case study and example to walk through the steps.
Odoo profiler
This slide explains about Profiling code in Odoo. And how to integrate with KCacheGrind to convert the profiling result into diagram
Passing The Joel Test In The PHP World
The document discusses Joel Spolsky's "Joel Test" which evaluates software development teams. It applies the test's 12 questions to PHP teams and provides recommendations. Key points include using source control, continuous integration, bug tracking, specifications, estimating tasks, and providing developers with resources to do their jobs.
Similar to Poing: a coder’s take on protein modelling (20)
Lean engineering for lean/balanced teams: lessons learned (and still learning...
Lean engineering for lean/balanced teams: lessons learned (and still learning...
Scratching the itch, making Scratch for the Raspberry Pie
Scratching the itch, making Scratch for the Raspberry Pie
Do Your Homework! Writing tests for Data Science and Stochastic Code - David ...
Do Your Homework! Writing tests for Data Science and Stochastic Code - David ...
Confoo 2024 Gettings started with OpenAI and data science
Confoo 2024 Gettings started with OpenAI and data science
Recently uploaded
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Communications Mining Series - Zero to Hero - Session 1
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
20240607 QFM018 Elixir Reading List May 2024
Everything I found interesting about the Elixir programming ecosystem in May 2024
Climate Impact of Software Testing at Nordic Testing Days
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Recently uploaded (20)
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Poing: a coder’s take on protein modelling
- 1. poing a coder's take on protein modelling Benjamin Jefferys Imperial College London [email_address]
- 3. DNA gene mRNA amino acid chain protein structure