UI Improvements - Dan Clarizio, Eric Winchell - ManageIQ Design Summit 2016ManageIQ
ManageIQ UI Improvements by Dan Clarizio and Eric Winchell at ManageIQ Design Summit 2016
Dialog Editor demo: https://youtu.be/ikAshtnQG0o (by Roman Blanco)
UI Improvements - Dan Clarizio, Eric Winchell - ManageIQ Design Summit 2016ManageIQ
ManageIQ UI Improvements by Dan Clarizio and Eric Winchell at ManageIQ Design Summit 2016
Dialog Editor demo: https://youtu.be/ikAshtnQG0o (by Roman Blanco)
With the impending release of ManageIQ Botvinnik, we wanted to walk through what we're doing in the ManageIQ Community, and what you can do with the new release. In this session, we discussed the following:
- OpenStack infrastructure management
- The Foreman integration - enabling providers for config management
- Comprehensive systems management for modern IT
- Inventory and asset management, the core of ManageIQ
Download the new release at http://manageiq.org/download/
VMware vSphere - Adam Grare - ManageIQ Design Summit 2016ManageIQ
ManageIQ for VMware vSphere by Adam Grare at ManageIQ Design Summit 2016
VDS demo: https://youtu.be/jXdTR57wFkw
Reconfigure demo: https://youtu.be/LM467glp2LI
From business requirements to working pipelines with apache airflowDerrick Qin
In this talk we will be building Airflow pipelines. We’ll look at real business requirements and walk through pipeline design, implementation, testing, deployment and troubleshooting - all that by adhering to idempotency and ability to replay your past data through the pipelines.
With the impending release of ManageIQ Botvinnik, we wanted to walk through what we're doing in the ManageIQ Community, and what you can do with the new release. In this session, we discussed the following:
- OpenStack infrastructure management
- The Foreman integration - enabling providers for config management
- Comprehensive systems management for modern IT
- Inventory and asset management, the core of ManageIQ
Download the new release at http://manageiq.org/download/
VMware vSphere - Adam Grare - ManageIQ Design Summit 2016ManageIQ
ManageIQ for VMware vSphere by Adam Grare at ManageIQ Design Summit 2016
VDS demo: https://youtu.be/jXdTR57wFkw
Reconfigure demo: https://youtu.be/LM467glp2LI
From business requirements to working pipelines with apache airflowDerrick Qin
In this talk we will be building Airflow pipelines. We’ll look at real business requirements and walk through pipeline design, implementation, testing, deployment and troubleshooting - all that by adhering to idempotency and ability to replay your past data through the pipelines.
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Globus
The U.S. Geological Survey (USGS) has made substantial investments in meeting evolving scientific, technical, and policy driven demands on storing, managing, and delivering data. As these demands continue to grow in complexity and scale, the USGS must continue to explore innovative solutions to improve its management, curation, sharing, delivering, and preservation approaches for large-scale research data. Supporting these needs, the USGS has partnered with the University of Chicago-Globus to research and develop advanced repository components and workflows leveraging its current investment in Globus. The primary outcome of this partnership includes the development of a prototype enterprise repository, driven by USGS Data Release requirements, through exploration and implementation of the entire suite of the Globus platform offerings, including Globus Flow, Globus Auth, Globus Transfer, and Globus Search. This presentation will provide insights into this research partnership, introduce the unique requirements and challenges being addressed and provide relevant project progress.
Graspan: A Big Data System for Big Code AnalysisAftab Hussain
We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs.
We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations.
These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18.
- Accepted in ASPLOS ‘17, Xi’an, China.
- Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17.
- Invited for presentation at SoCal PLS ‘16.
- Invited for poster presentation at PLDI SRC ‘16.
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
GraphSummit Paris - The art of the possible with Graph TechnologyNeo4j
Sudhir Hasbe, Chief Product Officer, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Atelier - Innover avec l’IA Générative et les graphes de connaissancesNeo4j
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement.
Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.
Developing Distributed High-performance Computing Capabilities of an Open Sci...Globus
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among public health practitioners, mathematical modelers, and scientific computing specialists, while revealing critical gaps in exploiting advanced computing systems to support urgent decision making. Informed by our team’s work in applying high-performance computing in support of public health decision makers during the COVID-19 pandemic, we present how Globus technologies are enabling the development of an open science platform for robust epidemic analysis, with the goal of collaborative, secure, distributed, on-demand, and fast time-to-solution analyses to support public health.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxrickgrimesss22
Discover the essential features to incorporate in your Winzo clone app to boost business growth, enhance user engagement, and drive revenue. Learn how to create a compelling gaming experience that stands out in the competitive market.
Software Engineering, Software Consulting, Tech Lead, Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Transaction, Spring MVC, OpenShift Cloud Platform, Kafka, REST, SOAP, LLD & HLD.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
7. Darga-2
● Released on June 30, 2016
● Blog post: http://manageiq.org/blog/2016/06/darga-2-announcementt/
● Download: http://manageiq.org/download/
8. Community Update
(Carol Chen)
● ManageIQ Design Summit 2016
○ Video recordings of the sessions are being uploaded to the playlist this week
○ https://www.youtube.com/playlist?list=PLQAAGwo9CYO-4tQsnC6oWgzhPNOykOOMd
○ Thanks for all your feedback! They are extremely helpful in our plans for future events
● Red Hat Summit 2016
○ ManageIQ booth in the Community Central
○ Received lots of interest from users, developers, partners, Red Hat customers, etc.
○ Check out some highlights on twitter: https://twitter.com/search?q=manageiq%
20rhsummit&src=typd
● Manageiq.org website
○ Redesign of the web site, planning started - initial messaging, wireframes
○ Improved user experience, updated info and documentation, and more
○ Next steps: gather content, requirements, decide on implementation tools
○ Will be integrated with github, so everyone can contribute easily by submitting PRs with
content in markdown
13. Providers - Hawkular
(A. Bonas)
● New operations on servers and deployments
○ Undeploy/redeploy a deployment entity
○ Reload/suspend/resume servers
● Live metrics
○ Added for datasources and transactions
○ Refactor infrastructure for easier configuration
● Performance reports for middleware servers
● Alerts - added support for alert profile and alert
automated expressions for middleware server
14. Providers - Hawkular
(A. Bonas)
● Crosslink middleware servers with RHEV VMs
● Collect and display deployment status
● Add datasources to topology view
● Icons
○ Resolve missing icons in several views
○ Add new icons (jms) and enhance existing icons
● Upgraded hawkular gem version to 2.2.1
● Solve misc bugs (UI, refresher, etc.)
15. Providers - AnsibleTower
Greg McCullough
● Automate Method updated to pass JobTemplate “Extra
Variables” defined in the Provision Task
○ Any keys in the options hash starting with ‘dialog_param_’ are passed to
AnsibleTower when launching the JobTemplate
16. User Interface
Dan Clarizio
● PRs merged (147)
○ SSUI (10)
○ Bugs (68)
○ Enhancements (25)
○ Backported to Darga (55)
● Refactoring
○ Default Filters tree converted to TreeBuilder - more on the way
○ Cloud Key Pair form converted to AngularJS (Dana - UX team)
○ Toolbars - Cleaned up partials, YAML -> classes
● Enhancements
○ Settings moved to top right navigation header
○ C3 Charts fully implemented - chart interaction coming soon!
○ Tagging for Ansible job templates
○ Live Search added to bootstrap selects
○ Self Service UI Order History
○ Provider forms - Credentials Validation improvements
29. Platform
Gregg Tanzillo
Custom Attributes - Reporting output (new way)
● CustomAttribute.value is now reported in the column titled
with the corresponding CustomAttribute.name
32. REST API
Alberto Bellotti
Refactoring
Goal - moving monolithic ApiController to OO model with
collection specific classes and inheriting generic methods.
● Api::Settings for accessing api.yml
● @req encapsulated as RequestAdapter
● Rails routing for API now driven by api.yml
● Clarifying rspecs
33. REST API
Alberto Bellotti
Added support for Report schedules
● Adding a schedule to a report:
POST /api/reports/:id
{
“action” : “schedule”,
“resource” : { … }
}
Schedule can include: name, enabled, description, start_date, interval, …
● GET /api/reports/:id/schedules
● GET /api/reports/:id/schedules/:schedule_id
34. REST API
Alberto Bellotti
Added support for approving or denying service
requests:
POST /api/service_requests/:id - Approving a service request
{
“action” : “approve”,
“resource” : { “reason” : “approve reason” }
}
POST /api/service_requests/:id - Denying a service request
{
“action” : “deny”,
“resource” : { “reason” : “deny reason” }
}
POST /api/service_requests - Approving or Denying multiple service requests
35. REST API
Alberto Bellotti
Added support for Openshift Container
Deployments:
Provided via a new collection /api/container_deployments:
Fetching data used for container deployments:
● GET /api/container_deployments/container_deployment_data
Creating and Querying container deployments:
● POST /api/container_deployments - Creating a new container deployment
● GET /api/container_deployments/:id - Get a specific container deployment
● GET /api/container_deployments - Querying all container deployments
36. REST API
Alberto Bellotti
Added support for Virtual Templates:
Capability provided via a new /api/virtual_templates collection
● Full CRUD on /api/virtual_templates
○ GET /api/virtual_templates - Query all virtual templates
○ GET /api/virtual_templates/:id - Query single virtual template
○ POST /api/virtual_templates - Create a new virtual template
○ POST /api/virtual_templates/:id - action “edit” to edit a virtual template
○ DELETE /api/virtual_templates/:id - Delete a virtual template
○ POST /api/virtual_templates/:id - action “delete” to delete a virtual template
● Also adding support for provision action
○ POST /api/virtual_templates/:id - action “provision” to provision a virtual template
37. Service Broker
Chris Kacerguis
● Started work on Server Broker - Allow ManageIQ to select
VM for you based on criteria (cloud, cost, or performance)
● Added API backend for Resourceless Servers
(api/virtual_templates)
● Added datastore for the default settings for resourceless
servers
38. Automate
Greg McCullough
● Generic Object
○ Model refactoring / Cleanup
○ Change to use PostgreSQL jsonb column
○ In progress: Relationships
● Service resolution based on Provision Order
○ Added ‘sequencer’ state to Service state machines
○ New state runs existing ‘GroupSequenceCheck’ method
■ CatalogItemInitialization, provision_from_bundle
○ Updated Namespaces:
■ ManageIQ / Cloud / Orchestration / Provisioning / StateMachine
■ ManageIQ / ConfigurationManagement / AnsibleTower / Service / Provisioning / StateMachines
■ ManageIQ / Service / Provisioning / StateMachines
39. ● Add /System/Process/MiqEvent instance
○ Problem: After Event-Switchboard refactoring the
/System/Process/Event instance requires an event object (not just an
event name) to resolve the instance path.
○ Solution: The new MiqEvent instance enables a user to create custom
buttons or Simulate to run and use simulate for MiqEvents.
○ Example: VM retirement warn from custom button on VM
● Added Provider refresh call to Amazon retire state
machine in Pre-Retirement state.
○ Avoids retry timeouts waiting for updated Provider inventory data
Automate
Greg McCullough
40. Automate
Greg McCullough
● Service Dialogs
○ Added ‘Visible’ flag to all dialog fields
○ In progress: Setting visible property from Dynamic dialog script
41. Null Coalescing Operator
● Multiple String values separated by “||”
● Evaluated on new attribute data type “Null Coalescing”
● Order dependent, left to right evaluation
● First non-blank value is used
● Skip and warn about missing objects
e.g.
${/#owner.email} || ${/#miq_request.get_option(:owner_email)} || ${/#miq_request.
requester.email} || ${/#config.to_email_address}
Automate
Madhu Kanoor
43. Accessing VMDB objects
● Class Schema allows for the following new data types
○ EMS (Provider)
○ Host
○ Policy
○ Provision
○ Request
○ Server
○ Storage
○ User
○ VM (or Template)
● The value contains the id of the object
○ e.g. ${/#vm.evm_owner_id}
● If the object is not found the attribute is not defined
Automate
Madhu Kanoor
46. SmartState
(Rich Oliveri)
● Added generalized disk LRU caching module.
○ Currently, caching implemented in disk modules that
require it.
○ Caching module can be used by any disk module -
eliminating duplication.
○ Can be inserted “higher” in the IO path.
○ Configurable caching parameters (memory vs
performance)
○ Will be employed to address Azure performance and
throttling issues.
○ Other disk modules converted over time.
47. Performance
(Dennis Metzger)
● 12 Performance PRs Merged
● Cap & U Improvements
○ Driven by the need to reduce collection scheduling time
○ Reduced number of SQL queries
○ Reduced number of objects
● Improved tag processing related to Alert Profiles
○ Reduced memory consumption by 50%
● UI Performance
○ Specific pages targeted based on customer feedback
○ Up to a 98% reduction in rendering times
■ e.g. Services to Request from 11.6 seconds to 0.25 seconds