Ecosys Experiment Engine

•

2 likes•308 views

Rob SImmonds's presentation on the Ecosys Experiment Engine project from Cybera's lunch 'n learn event on March 20, 2008.

Ecosys
Experiment
Engine
Rob Simmonds
Grid Research Centre
University of Calgary

Grid Research Centre (GRC)
• Perform R in:
– Grid computing
– High Performance Computing
– Cyberinfrastructure
– Automation
– Virtualization

• People
– Executive director
– Research director
– 5 research staff
– 5 students

• http://grid.ucalgary.ca

Objective
• Create Ecosys Experiment Engine by
integrating CI components
• This should:
– Manage multiple experiments and automate
the running of jobs and movement of data
– Manage jobs running on multiple clusters to
improve throughput
– Provide high level interface to reduce
learning curve

Reaching customers in new target locales requires an enterprise-wide content strategy that will circumvent language and cultural barriers, fit seamlessly into existing content workflows and not break the bank. In this webinar Brian discusses how to develop a flawless content strategy by bringing the power of Custom Machine Translated content in the mix. YouTube link: https://youtu.be/HG8-9vlKZkk

Teliko ekf - g lukeioy gp diagonisma prosomoiosis lisari team 2016 one-file

Christos Loizos

Visual

Luis De La Rosa

Federated Cloud Computing

David Wallom

Tackling Unwieldy Projects with XP

VMware Tanzu

SpringOne Platform 2016 Speakers: Joseph Rodriguez; Engineering Manager, Pivotal. Peter Clowes; Software Developer, Savoya. Are you taking on a large project that seems insurmountable? Perhaps a full rewrite, migrating to the cloud, or a large ETL? Extreme Programming can help! Following a full rewrite of our legacy application, we were tasked with transferring data from Oracle to Postgres- with an entirely different schema. This session covers basic principles of XP and how they helped get us to production in under 2 months.

Microsoft White PaperTim Cashman

AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...

Amazon Web Services

Amazon WorkSpaces is a desktop computing service that runs in the cloud, and now offers GPU configurations to support design and engineering applications and three-dimensional modeling. We show you how running these applications on Amazon WorkSpaces graphics bundles, in close proximity to data you already store on AWS, can help you process and visualize the results you need. We discuss the economics of running Amazon WorkSpaces graphics bundles, and demonstrate the experience of running a graphics-intensive application on a GPU-enabled Amazon WorkSpace. We also invite Autodesk (or TRC or ESRi) to discuss how they are using Amazon WorkSpaces graphics bundles in their business.

How to Architect AWS for Mission-Critical Applications

LogicworksNYC

Data center and cloud

ahmed sami

Curiosity Software and RCG Global Services Present - Solving Test Data: the g...

Curiosity Software Ireland

This webinar was co-hosted by Curiosity and RCG Global Services on January 20th, 2022. Watch the webinar on demand: https://www.curiositysoftware.ie/solving-test-data-webinar Outdated test data management practices are today a sinkhole for testing and development time. They stifle release velocity, risk costly legislative non-compliance, and yet still do not provide the data needed to protect releases from damaging bugs. To achieve true quality at speed, the test data paradigm must shift. Enterprises must move beyond slowly copying large sets of production data to a limited number of out-of-date test environments. In this webinar, Global Head of Quality Engineering at RCG, Niko Mangahas, draws on extensive project experience to define the test data challenges facing enterprises today. He then helps you identify the right test data solution for your organisation, setting out principles for effective requirements gathering and program design. Niko then hands over to veteran test data inventor, Huw Price, who demoes some of the latest techniques for making complete and compliant data available on-the-fly during parallel testing, development, and CI/CD.

eHarmony in the Cloud

Craig Dickson

USENIX NSDI 2016 (Session: Resource Sharing)

Ryousei Takano

Cisco Big Data Use CaseErni Susanti

cisco_bigdata_case_study_1Erni Susanti

How HashiCorp platform tools can make the difference in development and deplo...

Dmytro Mykhailov

I Love APIs 2015: Apache Usergrid Web Scale Mobile APIs with Elastic Search a...

Apigee | Google Cloud

Geek Sync | Deployment and Management of Complex Azure Environments

IDERA Software

You can watch the replay of this Geek Sync webinar in the IDERA Resource Center: http://ow.ly/pg7N50A4svf. Today's data management professional is finding their landscape changing. They have multiple database platforms to manage, multi-OS environments and everyone wants it now. Join IDERA and Kellyn Pot’Vin-Gorman as she discusses the power of auto deployment in Azure when faced with complex environments and tips to increase the knowledge you need at the speed of light. Kellyn will cover scripting basics, advanced Portal features, opportunities to lessen the learning curve and how multi-platform and tier doesn't have to mean multi-cloud. Attendees can expect to learn how to build automation scripts efficiently, even if you have little scripting experience, and how to work with Azure automation deployments. This session will allow you to begin building a repository of multi-platform development scripts to use as needed. About Kellyn: Kellyn Pot’Vin-Gorman is a member of the Oak Table Network and an IDERA ACE and Oracle ACE Director alumnus. She is the newest Technical Solution Professional in Power BI with AI in the EdTech group at Microsoft. Kellyn is known for her extensive work with multi-database platforms, DevOps, cloud migrations, virtualization, visualizations, scripting, environment optimization tuning, automation, and architecture design. She has spoken at numerous technical conferences for Oracle, Big Data, DevOps, Testing and SQL Server. Her blog, http://dbakevlar.com and social media activity under her handle, DBAKevlar is well respected for her insight and content.

Building a "Cloud Ready" IT Team

Amazon Web Services

How do you change business processes and bring about a change within your organisation to take advantage of the pay as you go model? Organisations, People, Procurement Processes are all impacted by this model. This session will cover user cases on how some organisations have successfully transition their business to take advantage of the benefits of the Cloud. Presenter: Glen Gore, Senior Manager, Solution Architects - APAC, Amazon Web Services

Viewers also liked

Proyecto pedagogico

Julia Elena Ponte

Proxwrhmena themata b_gymnasiou

Christos Loizos

Driver's LicenseRebecca Bartley

Fuente samsung bn44 00338b-1

giovanni mendoza

Go global with this Winning Combination – Content strategy and Machine Transl...

kantanmt

Teliko ekf - g lukeioy gp diagonisma prosomoiosis lisari team 2016 one-file

Christos Loizos

Visual

Luis De La Rosa

Viewers also liked (7)

Proyecto pedagogico

Proxwrhmena themata b_gymnasiou

Driver's License

Fuente samsung bn44 00338b-1

Go global with this Winning Combination – Content strategy and Machine Transl...

Teliko ekf - g lukeioy gp diagonisma prosomoiosis lisari team 2016 one-file

Visual

Similar to Ecosys Experiment Engine

Federated Cloud Computing

David Wallom

Tackling Unwieldy Projects with XP

VMware Tanzu

Microsoft White PaperTim Cashman

AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...

Amazon Web Services

How to Architect AWS for Mission-Critical Applications

LogicworksNYC

Data center and cloud

ahmed sami

Curiosity Software and RCG Global Services Present - Solving Test Data: the g...

Curiosity Software Ireland

eHarmony in the Cloud

Craig Dickson

USENIX NSDI 2016 (Session: Resource Sharing)

Ryousei Takano

Cisco Big Data Use CaseErni Susanti

cisco_bigdata_case_study_1Erni Susanti

How HashiCorp platform tools can make the difference in development and deplo...

Dmytro Mykhailov

I Love APIs 2015: Apache Usergrid Web Scale Mobile APIs with Elastic Search a...

Apigee | Google Cloud

Geek Sync | Deployment and Management of Complex Azure Environments

IDERA Software

Building a "Cloud Ready" IT Team

Amazon Web Services

Scalable server component using NodeJS & ExpressJS

Andhy Koesnandar

Talk that Andhy Koesnandar and Oby Sumampouw gave at Jakarta JS 12-15-2014 Title: Scalable server component using NodeJS & ExpressJS Description: Today is a wonderful time to be a JS developer. JS is the lingua franca in the web browser, apps and now server. I am going to talk about How JS developers can build server scalable component using NodeJS + ExpressJS . About Cermati: Cermati is a financial comparison site in Indonesia. We compare credit cards and promotions

Estimating the Total Costs of Your Cloud Analytics Platform

DATAVERSITY

Organizations today need a broad set of enterprise data cloud services with key data functionality to modernize applications and utilize machine learning. They need a platform designed to address multi-faceted needs by offering multi-function Data Management and analytics to solve the enterprise’s most pressing data and analytic challenges in a streamlined fashion. They need a worry-free experience with the architecture and its components.

True Reusable Code - DevSum2016

Eduard Lazar

Trenowanie i wdrażanie modeli uczenia maszynowego z wykorzystaniem Google Clo...

Sotrender

Okej, mam już mój świetny model w Notebooku, co dalej? Większość kursów i źródeł dotyczących uczenia maszynowego dobrze przygotowuje nas do implementacji algorytmów uczenia maszynowego i budowy mniej lub bardziej skomplikowanych modeli. Jednak w większości przypadków model jest jedynie małym fragmentem większego systemu, a jego wdrożenie i utrzymywanie okazuje się w praktyce procesem czasochłonnym i generującym rozmaite błędy. Problem potęguje się kiedy mamy do sproduktyzowania nie jeden, a więcej modeli. Choć z roku na rok powstaje coraz więcej narzędzi i platform do usprawnienia tego procesu, jest to zagadnienie któremu wciąż poświęca się stosunkowo mało uwagi. W mojej prezentacji przedstawię jakich podejść, dobrych praktyk oraz narzędzi i usług Google Cloud Platform używamy w Sotrender do efektywnego trenowania i produktyzacji naszych modeli ML, służących do analizy danych z mediów społecznościowych. Omówię na które aspekty DevOps zwracamy uwagę w kontekście wytwarzania produktów opartych o modele ML (MLOps) i jak z wykorzystaniem Google Cloud Platform można je w łatwy sposób wdrożyć w swoim startupie lub firmie. Prezentacja Macieja Pieńkosza z Sotrendera poczas Data Science Summit 2020

Scala, ECS, Docker: Delayed Execution @Coursera

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1stYuc2. Brennan Saeta covers aspects of Coursera’s architecture that enables them to rapidly build sophisticated features for their learning platform. Saeta discusses also their experience running containers in production, what works, what doesn’t, and why. He briefly touches upon container threat models, and how to architect a defense-in-depth strategy to mitigate both known and unknown vulnerabilities. Filmed at qconlondon.com. Brennan Saeta is a Lead Infrastructure Engineer, leading the ‘Cour’ (core) group responsible for the development environment, core libraries, and the common infrastructure powering Coursera.

Similar to Ecosys Experiment Engine (20)

Federated Cloud Computing

Tackling Unwieldy Projects with XP

Microsoft White Paper

AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...

How to Architect AWS for Mission-Critical Applications

Data center and cloud

Curiosity Software and RCG Global Services Present - Solving Test Data: the g...

eHarmony in the Cloud

USENIX NSDI 2016 (Session: Resource Sharing)

Cisco Big Data Use Case

cisco_bigdata_case_study_1

How HashiCorp platform tools can make the difference in development and deplo...

I Love APIs 2015: Apache Usergrid Web Scale Mobile APIs with Elastic Search a...

Geek Sync | Deployment and Management of Complex Azure Environments

Building a "Cloud Ready" IT Team

Scalable server component using NodeJS & ExpressJS

Estimating the Total Costs of Your Cloud Analytics Platform

True Reusable Code - DevSum2016

Trenowanie i wdrażanie modeli uczenia maszynowego z wykorzystaniem Google Clo...

Scala, ECS, Docker: Delayed Execution @Coursera

More from Cybera Inc.

Cyber Summit 2016: Technology, Education, and Democracy

Cybera Inc.

What are the opportunities and the challenges offered by emerging modes of technologically-inflected communication and decision-making? What is our role and responsibility as educators and as developers of research and teaching digital infrastructures? What do students need in the 21st century? As education institutions and providers struggle to respond to the first two questions, are we abrogating our responsibility to the last? In this talk, Matt Ratto will describe some of the opportunities and the challenges we currently face, laying out a model of action for how to potentially address the questions raised above. Core to his thinking are two related points; first that we must help students develop a greater sense of how the informational world and its attendant infrastructures helps shape how and what we think, and second, that a good way to do this is to give students the space to engage in reflexive acts of technological production – what Matt has termed ‘critical making.’ He will provide concrete examples from both his research and his teaching that demonstrate the value and importance of reflexive, hands-on work with digital technologies in helping students develop the critical digital literacy skills they need to function in today’s society. Matt Ratto is an Associate Professor in the Faculty of Information at the University of Toronto and directs the Semaphore Research cluster on Inclusive Design, Mobile and Pervasive Computing and, as part of Semaphore, the Critical Making lab.

Cyber Summit 2016: Understanding Users' (In)Secure Behaviour

Cybera Inc.

There is a prevailing belief that users are the weakest link the security chain. In this presentation, Dr. Chiasson discusses how this perspective is inherently counterproductive to achieving increased cyber security and explore alternatives with a higher chance of improving security. Why do users behave insecurely even though most will readily state that security and privacy are important? This talk will cover some of our recent research exploring reasons why users' actions do not necessarily reflect their desire for security and how the configuration of security systems may actually weaken security in practice. She presents her work using eye-tracking to determine how users make phishing determinations, and how we can persuade users to behave more securely through improving their mental models of passwords and by making adjustments to the system configurations.

Cyber Summit 2016: Insider Threat Indicators: Human Behaviour

Cybera Inc.

Serious threats to private and governmental organizations do not only come from the outside world, but also come from within. Some employees and contractors with legitimate access to buildings, networks, assets and information deliberately misuse their priviledged access to cause harm to their organization. What are the reasons behind their actions? Is it debts, greed, ideology, disgruntlement, or divided loyalty? Regardless of their motivations or vulnerabilities, traitors have very similar types of personality and display a certain pattern of behaviours before committing an insider incident. As a prevention measure, it is vital that organizations and employees understand, recognize and detect the common indicators of insider threat. Would you recognize the signs? Mario Vachon is an Insider Threat Security Specialist with the RCMP Departmental Security Branch.

Cyber Summit 2016: Research Data and the Canadian Innovation Challenge

Cybera Inc.

Canada allocates a substantial amount of public funding to research, which is a critical factor in ensuring we remain innovative and competitive. Increasingly this funding is geared to the support and development of digital research infrastructure (DRI), including the underlying networks and the associated data acquisition, storage, analysis and visualization. In order to maximize the benefits of increasingly complex DRI and the research it facilitates, it is important to make sure data is properly stewarded, accessible and reusable. By adopting appropriate approaches to research data management we are better positioned to respond to challenges, such as effectively measuring research impacts, and ensuring the reproducibility, privacy, and security of research outputs. Research Data Canada (RDC) is a member-driven organization committed to developing a sustainable approach to research data management, one based on interoperability and best practices. This session will provide an update on the efforts of RDC and partner organizations, including: CANARIE, Compute Canada, CARL Portage Network, CASRAI, the TriAgencies, and the Leadership Council for Digital Infrastructure. Intersections with international activities and projects will also be highlighted. These efforts are ultimately designed to faciliate a cohesive national approach to research data management, and one based on a clearly articulated vision for supporting innovation and discovery in Canada. Mark Leggott is the Executive Director of Research Data Canada.

Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data

Cybera Inc.

The Internet has revolutionized how — and how much — each of us can know. Our digital tools put the knowledge of the world at our fingertips — and soon, maybe, right into our heads. But what kinds of of knowledge do our devices give us, and how are they reshaping and challenging the role that education and libraries should play in our lives? This talk was delivered by Michael Patrick Lynch, professor of philosophy at the University of Connecticut, where he directs the university’s Humanities Institute.

Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse

Cybera Inc.

Although there is no well-established definition of big data, its main characteristic is its sheer volume. Large volumes of data are generated by people (e.g., via social media) and by technology, including sensors (e.g., cameras, microphones), trackers (e.g., RFID tags, web surfing behavior) and other devices (e.g., mobile phones, wearables for self-surveillance/quantified self), whether or not they are connected to the Internet of Things. However, the large volumes of data needed to capitalize on the benefits of big data can to some extent also be established by the reuse of existing data, a source that is sometimes overlooked. Data can be reused for purposes similar to that for which it was initially collected, but also beyond these purposes. Similarly, data can be reused in its original context, but also beyond this context. However, such repurposing and recontextualizing of data may lead to privacy issues. For instance, data reuse may lead to issues regarding informed consent and informational self-determination. When the data is used for profiling and other types of predictive analytics, also issues regarding stigmatization and discrimination may arise. This presentation by Bart Custers, Head of Research, eLaw – Center for Law and Digital Technologies at Leiden University, The Netherlands, focuses on the privacy issues of big data sharing and reuse and how these issues could be addressed.

Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...

Cybera Inc.

Stephen Childs was hired by the University of Calgary to develop an individual-level predictive model mapping students' decisions to attend the University. In his experience, the higher education sector was slow to use all the data it has available, but this is now changing. As interest in making use of organizational data grows, staff must consider how these models will be used, and any problems that could arise. When individual predictions become the basis for decisions, how do we ensure our algorithms don't make existing problems worse? A framework for handling these issues now will let organizations handle these issues in a way that is consistent with their values. Given the culture of today's institutions, and the success of predictive analytics in other fields, there is no doubt that these tools will be used. These techniques can improve student success and the competitiveness of educational organizations, but the benefits should not be gained at the expense of individuals within the system. This talk will propose a set of best practices for using institutional data for predictive modelling to address equity, privacy and other concerns. We must start thinking of this now, before other practices become entrenched.

Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...

Cybera Inc.

Canada’s National Research and Education Network, like other ultra-speed research networks, has evolved to transfer massive amounts of data at 100Gbps and beyond. But with the volume of data traffic growing at more than 50% per year, the ability to move increasing volumes of data is challenging. What are the kinds of applications in research and education that are driving this growth? What are the implications of the coming data tsunami on our communication networks? And what happens to network economics to keep up with the demand? CANARIE’s Chief Technology Officer, Mark Wolff, explores these topics and offer insights into how the NREN will evolve to continue to meet the unique needs of Canada’s research and education community.

Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data

Cybera Inc.

The City of Calgary is responsible for providing municipal services to 1.1 million people and 16,000 employees with more than 700 sites and critical infrastructure units. The municipal services represent a $60B asset base including water and wastewater treatment plants, light rapid transit, emergency services, roads and recreation facilities, and has revenue and procurement streams of $4.0B annually. During his tenure, Owen Key, Chief Security Officer and the Chief Information Officer for the City, has implemented enterprise systems for CCTV, access and ID control, physical security information management systems, and has responsibility for information security.

Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...

Cybera Inc.

The law has long struggled to keep pace with the rapid change that comes with the Internet and new technologies. From the cross-border challenges posed by a global network to the privacy implications of big data, law and policy simply cannot move at “Internet speed.” Yet despite the difficulties, politicians and policy makers increasingly find themselves at the heart of emerging policy issues, asked to address the balance between privacy and surveillance, the competing copyright interests of creators and users, and the market structure for network providers and disruptive competitors. This keynote talk will explore the emerging law and policy challenges, highlighting how all Internet users have the opportunity to help shape the digital policy landscape. Dr. Michael Geist is a law professor at the University of Ottawa where he holds the Canada Research Chair in Internet and E-commerce Law.

Privacy, Security & Access to Data

Cybera Inc.

Do Universities Dream of Big Data

Cybera Inc.

Historically, the University of Alberta lacked a centrally managed repository for reporting data, resulting in inconsistency and disparity in access for units across campus. Meaningful and actionable reports were limited, and only focused on the interests and goals of the few units with data analysts who could synthesize the information. Over the last couple of years, the University of Alberta has undertaken major changes in how information is managed and utilized. At the forefront of this change has been an increased interest in supporting the development of analytics and supporting tools. Beginning with the implementation of a centrally managed data warehouse with self-service capabilities, and the introduction of cloud services with business process analysis tools, the University is just starting down the road of big data. This presentation explores opportunities and challenges for the University of Alberta in utilizing big data.

Predicting the Future With Microsoft Bing

Cybera Inc.

The next generation of data scientists will be asked to build predictive models that can extract inferences from very large datasets which are unobservable at the surface, even to the best domain experts. Microsoft has access to some truly large data sets, web and search data from the Bing search engine and social data through collaborations with Twitter. In this talk, we show you how a small team of data scientists used this data to build the Bing Predicts engine — a collection of machine learnt predictive models that is beating industry experts at predicting the outcome of events like the Super Bowl, the Oscars, elections and referendums and even breakthroughs in health sciences. The talk will also give a preview of how organizations can adopt a big data mindset to generate and experiment with large data sets and to make amazing predictions using their own data.

Analytics 101: How to not fail at analytics

Cybera Inc.

Are MOOC's past their peak?

Cybera Inc.

Opening the doors of the laboratory

Cybera Inc.

While the use of online instructional technologies allows the presentation of theoretical science materials, how do we deal with the fact that such courses often include hands-on labs? Laboratory simulations can only provide a solution for online students in a limited and often artificial way. Nearly 20 years ago, Athabasca University developed a solution to the problem of students having to travel to complete their lab work. Emerging technologies at the time allowed for quantitative physics labs to be sent to students as a small kit. The physics initiative was so successful, with over 5,000 students served, that it was picked up in other fields at Athabasca University. Over the years, such material has become cheaper, easier to use, and more integrated with modern computers. Athabasca is now pioneering ways to put real labs directly onto the internet. In this session, the methods used to make real lab experiences available to online students will be discussed, and some of them demonstrated.

Open City - Edmonton

Cybera Inc.

Unlocking the power of healthcare data

Cybera Inc.

Data science and the use of big data in healthcare delivery could revolutionize the field by decreasing costs and vastly improving efficiency and outcomes. There is an abundance of healthcare data in Canada, but it is mostly siloed and difficult to access due to privacy and security challenges. This session will offer insights into best practices for healthcare analytics programs, as well as use cases that demonstrate the potential benefits that can be realized through this work.

Checking in on Healthcare Data Analytics

Cybera Inc.

Open access and open data: international trends and strategic context

Cybera Inc.

Governments around the world fund billions of dollars in research every year. Ensuring that the results of research are available to the public, other researchers and industry has become an important underlying value in order to maximize the impact of our publicly funded research. This session will discuss what’s driving the trend towards greater openness and provide an overview of international developments that will help put Canada’s activities into context.

More from Cybera Inc. (20)