SPRINT 116 REVIEW
- Sprint Ending July 22, 2019
July 24, 2019
Meeting Start: 10:30 am EST
2
OVERVIEW
● Sprint Statistics (John Prause)
● Community Update (Carol Chen)
● UI (Harpreet Kataria)
● Providers (Adam Grare)
● Automate (Drew Uhlmann)
● Platform (Joe VLcek)
● API (Alberto Bellotti)
● QE (Mike Shriver)
● Documentation (Suyog)
● Summary
3
Total of 285 PRs merged across 102 ManageIQ Repos
Pull Requests from: 2019-07-09 - 2019-07-22
4
--Hammer-6releasedMay22
--Hammer-7releasedJun10
--Hammer-8releasedJul02
--Hammer-5releasedApr23
5
6
Repo Health Report - Code Climate
7
COMMUNITY UPDATE
(Carol Chen)
● ManageIQ Hammer 9 released: http://manageiq.org/blog/2019/07/Announcing-Hammer-9/ (#743)
● Ivanchuk branch created: http://talk.manageiq.org/t/ivanchuk-ivanchuk/4447
● DevConf.IN - August 2-3 in Bengaluru, India
○ ManageIQ booth, demos, swag
8
USER INTERFACE
(Harpreet Kataria)
PRs (UI, SUI, UI/REACT Components, V2V): 73 Bugs: 30, Enhancements: 21, Tech Debt/Refactoring: 5/8, others: 9
Enhancements
● Unify the HTML5 canvas-based remote consoles under a single endpoint (#5761)
● SUI: Add support for WebMKS remote consoles via a custom template (#1554)
● Make create dialog from template reusable (#5842)
● Add release info to About screen title (#5846)
● Overview > Optimization - new screen (#5819)
● Add Copy option to Catalog Item/Bundle (#5667)
● Add scopes for filtering Archived/Orphaned VMs based on RBAC (#5357)
● Add Cloud Services UI (#11 #13)
● Introduce AzureStack cloud provider (#5684)
● Zanata migrated over to Transifex
● Opening URLs through automate (#5688)
● Sorting, filtering and design of report result tables (#5171)
For more on classic UI Enhancements
9
USER INTERFACE
Overview > Optimization
10
USER INTERFACE
Add Copy option to Catalog Item/Bundle
11
USER INTERFACE
Add scopes for filtering Archived/Orphaned VMs based on RBAC
12
USER INTERFACE
Add Cloud Services UI
13
USER INTERFACE
Introduce AzureStack cloud provider
14
USER INTERFACE
Zanata migrated over to Transifex
15
USER INTERFACE
Opening URLs through automate
16
USER INTERFACE
Sorting, filtering and design
of report result tables
17
PROVIDERS
(Adam Grare)
Amazon
● Allow key pair deletion (#547)
○ Previously we disallowed deletion of key pairs that MIQ did not
create, we have removed this restriction
● Add new instance types (#545)
○ Added c5.12xlarge, c5.24xlarge, c5.metal, i3en.12xlarge,
m5.16xlarge, etc...
Azure Stack
● New provider!!
○ On premise version of Azure
● Supports Inventory Refresh, Events, VM Provisioning
18
PROVIDERS
(Adam Grare)
Redfish
● Expand inventory collection (#83)
○ Collect server NICs, server storage adapters, and server firmware
● Move inventory collections to core (#84)
○ Reduce provider code by moving more code to core to share with other
physical providers
SCVMM
● Fix guest power options to only be shown for running vms (#125)
19
PROVIDERS
(Adam Grare)
Ovirt
● Fix iSCSI storage refresh (#387)
○ Location was LUN ID when it should have been Volume Group ID
○ Caused issues when there were multiple LUNs per VG
● Remove refresh type setting, standardize on graph refresh (#388)
● Deprecate the v3 API which has been supplanted by v3 in all supported
versions (#389)
20
AUTOMATE
(Drew Uhlmann)
Nick C’s Abundance of Ansible Contributions
● Use escalate privilege setting in ansible services and automate methods (#19012)
● Make embedded ansible verbosity and execution_ttl work (#18989)
● Pass credentials from ansible playbook automate methods and services (#18969) to runner
(#18983)
● Pass hosts to runner from automate (#18957) and services (#18946)
● Restore ServiceAnsiblePlaybook#postprocess method (#18988) (Nick C)
21
AUTOMATE
(Drew Uhlmann)
Everyday Enhancements
● Add missing quota tags (#18656) (Jeff C)
● Add service_vars to pass variables between catalog items in a bundle (#338) (Lucy)
● Support for opening URL from the UI through automate. (#328) (Martin P)
● Add scope to list automate domains from ancestor tenants (#318) (Libor)
● AzureStack orchestration template provisioning (#5840) (Miha)
● Add copy option to Catalog Item/Bundle (#5667) (Zita)
22
AUTOMATE
(Drew Uhlmann)
Bugs N Things
● When copying ServiceTemplates, copy only direct custom buttons (#18960) (Zita)
● Include resource actions and picture in service template copy (#18973) (Greg)
● Allow Symbol deserialization in YAML.safe_load (#18967) (Roman)
● Use admin to auto-approve a request (#18626) (Lucy)
● Fix for default service dialog values not included in EVM when refreshed (#19005) (Erik)
● Restore the service tree hierarchy and implement lazy loading for nested services (#5686)
(Dávid)
23
PLATFORM
(Joe VLcek)
42 PRs merged
Technical Debt:
● Random refactoring and cleanup manageiq/18978
● Log only unique servers id used to process miq_request manageiq/18962
Bugs:
● Fix displayed sort order manageiq/18928
● Update virtual attribute version manageiq/18971
● Allow order fields to be subqueries with order manageiq/18909
● Update dependency on manageiq-appliance_console manageiq-appliance/244
● Fix Classification seeding manageiq/19000
● Allow modification of "Create new Picture" product feature on a role. manageiq/18982
24
PLATFORM
(Joe VLcek)
General Enhancement:
● Reduce query count for chargeback currency seed manageiq/18952
● Test infrastructure improvements awesome_spawn/46, manageiq/18987
● Add scope to list automate domains from ancestors tenants manageiq-automation_engine/318
● Modify method to hide columns dynamically in GTL list manageiq/18812
● New tool for exporting and importing schedules manageiq/19008
25
PLATFORM
(Joe VLcek)
Embedded Ansible Enhancement:
● Remove the old ask_*_on_launch options manageiq/19017
● Use escalate privilege setting in ansible services and automate methods manageiq/19012
● Make embedded ansible verbosity and execution_ttl work manageiq/18989
● Pass credentials from ansible playbook automate methods to runner manageiq/18983
● Pass credentials to ansible runner from services manageiq/18969
● Add credential handling to Ansible::Runner manageiq/18968
● Encrypt passwords before putting them on the queue as args manageiq/19006
● Pass hosts to runner from automate manageiq/18957
● Pass hosts to runner from services manageiq/18946
● Allow specifying hosts to ansible runner manageiq/18945
● Add doc comments and hosts to *_*queue methods in Ansible::Runner manageiq/18964
● Restore ServiceAnsiblePlaybook#postprocess method manageiq/18988
26
PLATFORM
(Joe VLcek)
Embedded Ansible Enhancement (cont.)
● Fix manager ref for credentials manageiq/18972
● Add NetworkCredential for Ansible::Runner lib manageiq/19007
● Add VaultCredential manageiq/19002
● Adds cloud credentials to AnsibleRunner manageiq/18991
● Fix key unlock machine creds manageiq/18984
27
PLATFORM
(Joe VLcek)
Ruby / Rails Version Bump:
● Bump master travis.yml to ruby 2.4.6 manageiq-graphql/74
● Remove serialization of non-existing classes/objects manageiq-schema/390
● Rails 5.2 raises an error for missing attribute default_tenant_role manageiq/19014
● Don't pass class objects as values to where manageiq/19016
● Fix rails 5.2 RecordNotSaved when trying to save a model association before the model manageiq/19015
● SQlite specifically needed for Rails 5.0 ovirt_metrics/29
● Loosen Rails dependency for Rails 5.2 ovirt_metrics/27
Continuous Integration / Testing:
● Fixed traivis failures manageiq-schema/389, log_decorator/8
28
API
(Alberto Bellotti)
● API version was updated for the Ivanchuk Release (Jason F.)
4.1.0-pre ⇒ 4.1.0
● Adding server release information - #628 (Satoe I.)
This enhancement extends the server_info section of the /api entrypoint to include the ManageIQ Release.
This was needed for the help about window in the UI.
GET /api
...
"server_info": {
...
"release" : "Ivanchuk",
"appliance" : "EVM",
...
}
29
API
(Alberto Bellotti)
● Enhanced service_dialogs to allow creation from templates - #616 (Richard V.)
This allows creation of service dialogs of additional types like AnsibleTowerJobTemplateDialogService by
using a common action.
POST /api/service_dialogs
{
“action” : “template_service_dialog',
“resource” : {
“label” : 'dialog label',
“template_id” : '569',
“template_class” : “OrchestrationTemplate”,
“dialog_class” : “Dialog::OrchestrationTemplateServiceDialog”
}
}
30
API
(Alberto Bellotti)
● Added support to update firmware - #597 (Miha P.)
This enhancement was needed for the UI. This allows the user to pick a firmware binary from a drop-down
and apply it to selected servers.
GET /api/physical_servers/:id/firmware_binaries
POST /api/requests
{
“options” : {
“request_type” : “physical_server_firmware_update”,
“src_ids” : [ 1, 2, 3],
“firmware_binary_id” : 1
}
}
31
QE
(Mike Shriver)
● Automate ansible tests for branched repos, playbooks, vault credentials (9032, 9038) (Satyajit Bulage)
● Container providers new CRUD test, including flash message assertion (9083) (Justin Watts)
● Repo cleanup and enhancements:
○ Add/Update BZ markers and blockers
○ Move manual test cases from generic module
● LogValidator update to provide better naming for Log monitoring pattern and to support waiting for log
messages (9031) (Nikhil Dhandre)
● Work started to drop Python 2.7 support
32
DOCUMENTATION
(Suyog)
PRs Merged in Sprint: 9
Bugs: 4
Enhancements: 5
Highlights:
-Removed content on deprecated topics:
● Optimize > Utilization | Planning | Bottleneck from Managing Infrastructure & Inventory and Deployment
Planning Guide [1185]
● Cloud Intel > RSS feed and Timelines UI from the Monitoring Alerts & Reporting doc. [1184]
● Classic Insights from the General Configuration guide [1181]
● Google Compute Engine provider info [1177]
-Documented ruby method move_into_folder(folder) with example [1176]
-Documented RFE about opening VMs of a remote region from global region and the new role in configuring db
replication/centralized administration section [1179]
33
SUMMARY
Sprint 117 Review - August 07, 2019
Meeting Start: 10:30 am EST
THANK YOU
manageiq.org github.com/ManageIQ
twitter.com/ManageIQ gitter.im/ManageIQ/manageiq
facebook.com/manageiq talk.manageiq.org
plus.google.com/+ManageiqOrg youtube.com/user/ManageIQVideo
linkedin.com/company/manageiq

Sprint 116

  • 1.
    SPRINT 116 REVIEW -Sprint Ending July 22, 2019 July 24, 2019 Meeting Start: 10:30 am EST
  • 2.
    2 OVERVIEW ● Sprint Statistics(John Prause) ● Community Update (Carol Chen) ● UI (Harpreet Kataria) ● Providers (Adam Grare) ● Automate (Drew Uhlmann) ● Platform (Joe VLcek) ● API (Alberto Bellotti) ● QE (Mike Shriver) ● Documentation (Suyog) ● Summary
  • 3.
    3 Total of 285PRs merged across 102 ManageIQ Repos Pull Requests from: 2019-07-09 - 2019-07-22
  • 4.
  • 5.
  • 6.
    6 Repo Health Report- Code Climate
  • 7.
    7 COMMUNITY UPDATE (Carol Chen) ●ManageIQ Hammer 9 released: http://manageiq.org/blog/2019/07/Announcing-Hammer-9/ (#743) ● Ivanchuk branch created: http://talk.manageiq.org/t/ivanchuk-ivanchuk/4447 ● DevConf.IN - August 2-3 in Bengaluru, India ○ ManageIQ booth, demos, swag
  • 8.
    8 USER INTERFACE (Harpreet Kataria) PRs(UI, SUI, UI/REACT Components, V2V): 73 Bugs: 30, Enhancements: 21, Tech Debt/Refactoring: 5/8, others: 9 Enhancements ● Unify the HTML5 canvas-based remote consoles under a single endpoint (#5761) ● SUI: Add support for WebMKS remote consoles via a custom template (#1554) ● Make create dialog from template reusable (#5842) ● Add release info to About screen title (#5846) ● Overview > Optimization - new screen (#5819) ● Add Copy option to Catalog Item/Bundle (#5667) ● Add scopes for filtering Archived/Orphaned VMs based on RBAC (#5357) ● Add Cloud Services UI (#11 #13) ● Introduce AzureStack cloud provider (#5684) ● Zanata migrated over to Transifex ● Opening URLs through automate (#5688) ● Sorting, filtering and design of report result tables (#5171) For more on classic UI Enhancements
  • 9.
  • 10.
    10 USER INTERFACE Add Copyoption to Catalog Item/Bundle
  • 11.
    11 USER INTERFACE Add scopesfor filtering Archived/Orphaned VMs based on RBAC
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
    16 USER INTERFACE Sorting, filteringand design of report result tables
  • 17.
    17 PROVIDERS (Adam Grare) Amazon ● Allowkey pair deletion (#547) ○ Previously we disallowed deletion of key pairs that MIQ did not create, we have removed this restriction ● Add new instance types (#545) ○ Added c5.12xlarge, c5.24xlarge, c5.metal, i3en.12xlarge, m5.16xlarge, etc... Azure Stack ● New provider!! ○ On premise version of Azure ● Supports Inventory Refresh, Events, VM Provisioning
  • 18.
    18 PROVIDERS (Adam Grare) Redfish ● Expandinventory collection (#83) ○ Collect server NICs, server storage adapters, and server firmware ● Move inventory collections to core (#84) ○ Reduce provider code by moving more code to core to share with other physical providers SCVMM ● Fix guest power options to only be shown for running vms (#125)
  • 19.
    19 PROVIDERS (Adam Grare) Ovirt ● FixiSCSI storage refresh (#387) ○ Location was LUN ID when it should have been Volume Group ID ○ Caused issues when there were multiple LUNs per VG ● Remove refresh type setting, standardize on graph refresh (#388) ● Deprecate the v3 API which has been supplanted by v3 in all supported versions (#389)
  • 20.
    20 AUTOMATE (Drew Uhlmann) Nick C’sAbundance of Ansible Contributions ● Use escalate privilege setting in ansible services and automate methods (#19012) ● Make embedded ansible verbosity and execution_ttl work (#18989) ● Pass credentials from ansible playbook automate methods and services (#18969) to runner (#18983) ● Pass hosts to runner from automate (#18957) and services (#18946) ● Restore ServiceAnsiblePlaybook#postprocess method (#18988) (Nick C)
  • 21.
    21 AUTOMATE (Drew Uhlmann) Everyday Enhancements ●Add missing quota tags (#18656) (Jeff C) ● Add service_vars to pass variables between catalog items in a bundle (#338) (Lucy) ● Support for opening URL from the UI through automate. (#328) (Martin P) ● Add scope to list automate domains from ancestor tenants (#318) (Libor) ● AzureStack orchestration template provisioning (#5840) (Miha) ● Add copy option to Catalog Item/Bundle (#5667) (Zita)
  • 22.
    22 AUTOMATE (Drew Uhlmann) Bugs NThings ● When copying ServiceTemplates, copy only direct custom buttons (#18960) (Zita) ● Include resource actions and picture in service template copy (#18973) (Greg) ● Allow Symbol deserialization in YAML.safe_load (#18967) (Roman) ● Use admin to auto-approve a request (#18626) (Lucy) ● Fix for default service dialog values not included in EVM when refreshed (#19005) (Erik) ● Restore the service tree hierarchy and implement lazy loading for nested services (#5686) (Dávid)
  • 23.
    23 PLATFORM (Joe VLcek) 42 PRsmerged Technical Debt: ● Random refactoring and cleanup manageiq/18978 ● Log only unique servers id used to process miq_request manageiq/18962 Bugs: ● Fix displayed sort order manageiq/18928 ● Update virtual attribute version manageiq/18971 ● Allow order fields to be subqueries with order manageiq/18909 ● Update dependency on manageiq-appliance_console manageiq-appliance/244 ● Fix Classification seeding manageiq/19000 ● Allow modification of "Create new Picture" product feature on a role. manageiq/18982
  • 24.
    24 PLATFORM (Joe VLcek) General Enhancement: ●Reduce query count for chargeback currency seed manageiq/18952 ● Test infrastructure improvements awesome_spawn/46, manageiq/18987 ● Add scope to list automate domains from ancestors tenants manageiq-automation_engine/318 ● Modify method to hide columns dynamically in GTL list manageiq/18812 ● New tool for exporting and importing schedules manageiq/19008
  • 25.
    25 PLATFORM (Joe VLcek) Embedded AnsibleEnhancement: ● Remove the old ask_*_on_launch options manageiq/19017 ● Use escalate privilege setting in ansible services and automate methods manageiq/19012 ● Make embedded ansible verbosity and execution_ttl work manageiq/18989 ● Pass credentials from ansible playbook automate methods to runner manageiq/18983 ● Pass credentials to ansible runner from services manageiq/18969 ● Add credential handling to Ansible::Runner manageiq/18968 ● Encrypt passwords before putting them on the queue as args manageiq/19006 ● Pass hosts to runner from automate manageiq/18957 ● Pass hosts to runner from services manageiq/18946 ● Allow specifying hosts to ansible runner manageiq/18945 ● Add doc comments and hosts to *_*queue methods in Ansible::Runner manageiq/18964 ● Restore ServiceAnsiblePlaybook#postprocess method manageiq/18988
  • 26.
    26 PLATFORM (Joe VLcek) Embedded AnsibleEnhancement (cont.) ● Fix manager ref for credentials manageiq/18972 ● Add NetworkCredential for Ansible::Runner lib manageiq/19007 ● Add VaultCredential manageiq/19002 ● Adds cloud credentials to AnsibleRunner manageiq/18991 ● Fix key unlock machine creds manageiq/18984
  • 27.
    27 PLATFORM (Joe VLcek) Ruby /Rails Version Bump: ● Bump master travis.yml to ruby 2.4.6 manageiq-graphql/74 ● Remove serialization of non-existing classes/objects manageiq-schema/390 ● Rails 5.2 raises an error for missing attribute default_tenant_role manageiq/19014 ● Don't pass class objects as values to where manageiq/19016 ● Fix rails 5.2 RecordNotSaved when trying to save a model association before the model manageiq/19015 ● SQlite specifically needed for Rails 5.0 ovirt_metrics/29 ● Loosen Rails dependency for Rails 5.2 ovirt_metrics/27 Continuous Integration / Testing: ● Fixed traivis failures manageiq-schema/389, log_decorator/8
  • 28.
    28 API (Alberto Bellotti) ● APIversion was updated for the Ivanchuk Release (Jason F.) 4.1.0-pre ⇒ 4.1.0 ● Adding server release information - #628 (Satoe I.) This enhancement extends the server_info section of the /api entrypoint to include the ManageIQ Release. This was needed for the help about window in the UI. GET /api ... "server_info": { ... "release" : "Ivanchuk", "appliance" : "EVM", ... }
  • 29.
    29 API (Alberto Bellotti) ● Enhancedservice_dialogs to allow creation from templates - #616 (Richard V.) This allows creation of service dialogs of additional types like AnsibleTowerJobTemplateDialogService by using a common action. POST /api/service_dialogs { “action” : “template_service_dialog', “resource” : { “label” : 'dialog label', “template_id” : '569', “template_class” : “OrchestrationTemplate”, “dialog_class” : “Dialog::OrchestrationTemplateServiceDialog” } }
  • 30.
    30 API (Alberto Bellotti) ● Addedsupport to update firmware - #597 (Miha P.) This enhancement was needed for the UI. This allows the user to pick a firmware binary from a drop-down and apply it to selected servers. GET /api/physical_servers/:id/firmware_binaries POST /api/requests { “options” : { “request_type” : “physical_server_firmware_update”, “src_ids” : [ 1, 2, 3], “firmware_binary_id” : 1 } }
  • 31.
    31 QE (Mike Shriver) ● Automateansible tests for branched repos, playbooks, vault credentials (9032, 9038) (Satyajit Bulage) ● Container providers new CRUD test, including flash message assertion (9083) (Justin Watts) ● Repo cleanup and enhancements: ○ Add/Update BZ markers and blockers ○ Move manual test cases from generic module ● LogValidator update to provide better naming for Log monitoring pattern and to support waiting for log messages (9031) (Nikhil Dhandre) ● Work started to drop Python 2.7 support
  • 32.
    32 DOCUMENTATION (Suyog) PRs Merged inSprint: 9 Bugs: 4 Enhancements: 5 Highlights: -Removed content on deprecated topics: ● Optimize > Utilization | Planning | Bottleneck from Managing Infrastructure & Inventory and Deployment Planning Guide [1185] ● Cloud Intel > RSS feed and Timelines UI from the Monitoring Alerts & Reporting doc. [1184] ● Classic Insights from the General Configuration guide [1181] ● Google Compute Engine provider info [1177] -Documented ruby method move_into_folder(folder) with example [1176] -Documented RFE about opening VMs of a remote region from global region and the new role in configuring db replication/centralized administration section [1179]
  • 33.
    33 SUMMARY Sprint 117 Review- August 07, 2019 Meeting Start: 10:30 am EST
  • 34.
    THANK YOU manageiq.org github.com/ManageIQ twitter.com/ManageIQgitter.im/ManageIQ/manageiq facebook.com/manageiq talk.manageiq.org plus.google.com/+ManageiqOrg youtube.com/user/ManageIQVideo linkedin.com/company/manageiq