The ManageIQ Sprint 58 review details the progress made during the sprint ending on April 10, 2017, highlighting contributions across various teams such as classic UI, service UI, providers, automation, platform, and API. Key statistics include the merging of 122 pull requests, the release of versions Euwe 2.1 and Fine Beta, and enhancements in provider integrations. Additionally, multiple bugs were addressed and new features were added to improve user experience and system performance.

1. ManageIQ
Sprint 58 Review - Sprint End April 10, 2017
April 12, 2017

2. Overview
● Sprint Statistics (Oleg Barenboim)
● Community Update (Carol Chen)
● Classic UI (Dan Clarizio)
● Service UI (Chris Kacerguis)
● Providers (Bronagh Sorota)
● Automate (Greg McCullough)
● Platform (Gregg Tanzillo)
● API (Alberto Bellotti)
● Performance (Dennis Metzger)
● Quality Engineering (Dave Johnson)
● Documentation (Steve Bream)
● Discussion

3. Sprint Statistics
(J. Frey)
122 Pull Requests Merged for ManageIQ/manageiq

4. PR Breakdown by Feature Category
on Manageiq/manageiq
* Note that some PRs
have more than one
category.

5. PRs Merged per Sprint
(J. Frey)

6. All Repo Stats - Top 10
(J. Frey)
Top Repositories # Closed
ManageIQ/manageiq-ui-classic 134
Manageiq/manageiq 122
ManageIQ/integration_tests 90
ManageIQ/manageiq-ui-service 48
ManageIQ/manageiq_docs 20
ManageIQ/manageiq-content 16
ManageIQ/manageiq-gems-pending 11
ManageIQ/manageiq-pods 9
ManageIQ/manageiq.org 9
ManageIQ/font-fabulous 5
Manageiq/manageiq-providers-vmware 5
Total of 538 across ALL ManageIQ Organization
New repositories:
● manageiq-providers-hawkular
● manageiq-providers-openstack
● manageiq-providers-ovirt
● amazon_ssa_support
● manageiq-automation_engine

7. Community Update
(Carol Chen)
● Releases
○ Euwe 2.1 released: http://manageiq.org/blog/2017/04/Announcing-Euwe-2.1/
○ Fine Beta released: http://manageiq.org/blog/2017/04/Announcing-Fine-Beta-Release/
○ G-release name voting: http://manageiq.org/blog/2017/04/vote-on-naming-g-release/
● Last Week in ManageIQ
○ http://manageiq.org/blog/2017/04/mostly-harmless-update/ by Roman Blanco
○ http://manageiq.org/blog/2017/04/blood-fire-manageiq/ by Robin Knaur
● Upcoming Events
○ RailsConf, Apr 25-27 in Phoenix, AZ - http://railsconf.com/program#session-113
○ FOSS-North, April 26 in Gothenburg, Sweden http://foss-north.se/talks.html#chen
○ Red Hat Summit, May 2-4 in Boston, MA https://www.redhat.com/en/summit/2017
○ OSCAL, May 13-14 in Tirana, Albania http://oscal.openlabs.cc/

8. Classic UI
(Dan Clarizio)
● PRs merged (134)
○ Enhancements (7)
○ Tech Debt / Refactoring (42)
○ Bugs (70)
○ Backported to Fine (91)

9. Classic UI - PRs by Area of UI

10. Classic UI
Enhancements
● Middleware - Show cross linking containers links
● Middleware - Added Smart JDBC driver defaults
This adds intelligent defaults when adding a JDBC driver instead of having to
know what the options are to key in
● Containers - Added SSO to External Logging link
Falls back to non-SSO in case of failure
● Physical Infrastructure - Added menu entry for Topology
● Ansible - “Refresh” button added to Repository’s and
Credential’s screens.
● Ansible - Playbook stdout now formatted as HTML
● Added Cockpit button for Cloud Instances

11. Classic UI
Middleware - Show cross linking containers links

12. Classic UI
Middleware - Added Smart JDBC driver defaults

13. Classic UI
Playbook stdout now formatted as HTML

14. Classic UI
Technical Debt / Refactoring
● Technical debt areas worked on
○ Topology
○ Angular, bower
○ RBAC, LDAP
○ Deduplication, styling, a bunch more!
● Refactoring
○ Mixins
○ Toolbars
○ Moving code to common areas
○ General cleanup to make things more readable

15. Service UI
(Chris Kacerguis)
Sprint 58 Team Burnup

16. Service UI
(Chris Kacerguis)
Bugs Fixed
● Dialog field visibility is not honored on dynamic fields in Service UI
● RBAC: Catalog Menu should be hidden or it should show Dashboard when no
permissions
● Service toolbar actions should be disabled if no service is selected
● persist catalog view state during session
● Dynamic check box does not update
● Left nav tooltips broken
● Address unexpected duplicate cart activity

17. Service UI
(Chris Kacerguis)
Bugs Fixed (cont)
● Initial explorer result counts are delayed
● Cockpit icon tooltip gets in the way of button click
● unclickable service cards
● Catalogs show counting of Service who are set to "don't display in Catalog"
● Fix dynamic service dialog validations
● tnav button overlap

18. Service UI
(Chris Kacerguis)
Bugs Fixed (cont)
● Hide list helpers in card view, catalogs
● Snapshot counter at Service level is not set
● Remove required description indicator from create snapshot
● Fix navigation rbac
● State reload on login
● Not able to see orders when not enough permission to see catalogs
● External authentication works when logging into the Admin UI but doesn't
work for the same user to get into the Service UI

19. Service UI
(Chris Kacerguis)
New Features
● Create Report Explorer / Viewer
● Hide Dialog Editor
● Enable RBAC on Services Explorer Page
● Order requests by most recent date
● Update stdout for ansible service
● Enable RBAC on Service Detail Page
● Hover text on request status should indicate the status (Approved/Denied)
● Added "Retire Now" to kebab menu for a resource
● Added Power Management button to VM details page

20. Service UI
(Chris Kacerguis)
Housekeeping
● Update external dependencies
● Adjusted .travis.yml to test LTS (6.x) and current version of Node (7.x)
● Updated yarn to latest version

21. Providers
(Bronagh Sorota)

22. Providers PR Distribution across
Repositories
Provider PRs
ansible_tower 15
containers 6
hawkular 6
amazon 5
openstack 5
physical-infrastructure 5
rhevm 5
azure 4
ovirt 3
lenovo 2
microsoft 2
cloud 1

23. Providers - Openstack
● Emit a notification when an Openstack VM relocation
operation completes
Providers - RHEV
● Update to the new oVirt SDK for event parsing

24. Providers - Lenovo
● Demo
Providers - Amazon
● Demo of AWS Tag Mapping (from sprint 57)

25. Providers - Ansible Tower
● Success/failure of a refresh
● Notification after Tower credential operations
● Playbooks are now deleted when Ansible inventory is
deleted.

26. Providers - Hawkular
● Add cross linking of middleware servers with containers
● Refresh was rewritten to use full graph refresh
● Stop using deprecated names from hawkular client gem
● Add JDBC driver dialog enhanced with default values per
driver type

27. Providers - Core
● 6 x faster EMS refresh time!
● Three provider repos have been split out with dedicated
gitter channels:
○ manageiq-providers-hawkular
○ manageiq-providers-openstack
○ manageiq-providers-ovirt

28. Automate
(Greg McCullough)

29. Automate
(Greg McCullough)
Ansible Integration
● Expose Project#update (ansible_tower_client_ruby gem)
● Protect in-use Ansible Service Template from being removed
● Ansible Playbook Service on_error handling
● Generic Service State Machine update_status enhancements
Bugs:
● Refresh Job in as part of error processing
● Parse password field from dialog before job launch
● Ansible Service: skip dialog options for retirement
● Modify before_destroy callback
● Update Dynamic dialog field to use Embedded Ansible instance for Machine credentials

30. Automate
(Greg McCullough)
● Automate Service Model Auto-creation
● Add Notifications for Ansible and Cloud provisioning errors
● ConfigurationManagement has been deprecated (use
AutomationManagement instead)
● Added EmsEvent namespace for LenovoXclarity Domain

31. Automate
(Greg McCullough)
Bug Fixes
● Display name and Description not updated during automate model import
● Fixed Service#my_zone when VM list includes archived VMs
● vmware_best_fit_least_utilized honors Host maintenance
● Provisioning Dialogs: First and Last name are no longer required fields.
● Add policy checking for host_scan request
● Add policy checking for retirement request
● Datawarehouse: Allow more than one alert per resource

32. Platform
(Gregg Tanzillo)
34 PRs Merged

33. Platform
● Enhancements
○ Build embedded Ansible with official RPMs
○ PostgreSQL
■ New directory and config file for ManageIQ specific settings
● /etc/manageiq/postgresql.conf.d/01_miq_overrides.conf
● /var/opt/rh/rh-postgresql95/lib/pgsql/data/postgresql.conf
untouched with defaults
■ Use new postgres config scheme
■ Use ALTER SYSTEM SQL commands rather than relying on
reference files and ERB
○ Tenancy - Enable RBAC all CloudTenant based models (Richard Su)
○ Enforce policies type to be either "compliance" or "control"

34. Platform
● Bug Fixes
○ Appliance console - Disk config for standby DB (screenshot)
○ Disable cloud-init network re-config on network updates
○ Do not show IPv6 network-prefix-length unless there is IPv6 address
○ Make worker_monitor_drb act like a reader again!
○ Do not show IPv6 network-prefix-length unless there is IPv6 address
○ Do not pass nil to the assignment mixin (Chargeback)
○ Fix regression in report formatting
○ Fix format for Tenant quotas report
○ Fix set ownership toolbar when instance doesn't have provider
○ Improve performance of BlacklistedEvent.seed
○ Use base class only when it is supported by direct RBAC
○ Fix queueing of historical metrics collection

35. Platform
Standby Disk Config

36. ● Technical Debt/Refactoring/Tests
○ Remove not used VmOrTemplate#miq_proxies and
MiqServer#miq_proxy
○ Refactor/clean up 'agent' related logic on `Job` model
○ Delete not used model VmSynchronization
○ Use existing method Field.sub_type
○ Extract chargeable field [6/8] -- stop seeding the stuff
○ Move ContainerDeploymentService + tests into this repo
○ Update some request factories
Platform

37. API
(Alberto Bellotti)
API Versioning Updates
■ Fine Release v2.4.0
■ Master / G-Release v2.5.0-pre

38. API
(Alberto Bellotti)
● Enhanced /api/settings to provide Settings->prototype
GET /api/settings
{
"product" : {
“maindb" : "ExtManagementSystem",
"container_deployment_wizard” : false,
"datawarehouse_manager" : false
},
"prototype" : {
"monitoring” : false
}
}

39. API
● Added support to edit VMs (Jillian T.)
○ For updating Custom Identifiers/Description/Parent/Children Vms/Templates
○ Not for Memory/Cpu (Reconfigure VMs, future enhancement)
POST /api/vms/:id - action “edit”
{
“action” : “edit”,
“resource” : {
“custom_1” : “new_custom_identifier”,
...
“custom_9” : “new_custom_identifier_9”,
“description” : “Updated VM Description”,
“parent_resource” : { “href” : “/api/vms/10” },
“child_resources” : [
{ “href” : “/api/vms/201” },
{ “href” : “/api/vms/202” },
...
]
}
}
POST /api/vms - action “edit” for bulk edits

40. API
● Added ability to remove resources from services (Jillian T.)
○ Implemented via the remove_resource action on services
POST /api/services/:id - action “remove_resource”
{
“action” : “remove_resource”,
“resource” : {
“resource” : { “href” : “/api/vms/11” }
}
}
POST /api/services - action “remove_resource” for bulk updates
{
“action” : “remove_resource”,
“resources” : [
{ “href” : “/api/services/1”, “resource” : { “href” : “/api/vms/101” } },
{ “href” : “/api/services/1”, “resource” : { “href” : “/api/vms/102” } },
{ “href” : “/api/services/2”, “resource” : { “href” : ”/api/vms/201” } },
...
]
}

41. API
● Added ability to remove all services resources (Jillian T.)
○ Implemented via the remove_all_resources action on services
POST /api/services/:id - action “remove_all_resources”
{
“action” : “remove_all_resources”
}
POST /api/services - action “remove_all_resources” for bulk updates
{
“action” : “remove_all_resources”,
“resources” : [
{ “href” : “/api/services/101” },
{ “href” : “/api/services/102” },
...
]
}

42. Performance
(Dennis Metzger)
Inventory Refresh
In addition to continued work on the new Graph and Targeted
refreshes, enhancements were made to the existing refresh.
In testing, the enhancements reduced a 120+ minute refresh
of a large environment to 22 minutes.
Changes were to the inventory save and are provider
agnostic.

43. Performance
MiqQueue
MiqQueue.get()
Removed a count(*), resulting in a 20% speed
improvement
Removed an unneeded worker lookup, resulting in a 6%
speed improvement and 16% reduction in memory used

44. Performance
Database Seeding
Created a proposal for changing how (when) we seed the database
Currently seeded on every appliance boot, which precludes parallel appliance
startup in addition to increasing the startup time per appliance
BlackListedEvent.seed was enhanced by reducing the number of selects used (42
selects down to 1). Testing showed a 96% reduction in time required to seed the
BlackList.

45. Quality Engineering
Sprint #4 (Dholak) ended yesterday.
PR type Count
enhancement 18
fix-test 11
new-test-or-feature 16
fix-framework 14
tech-debt 8
fix-locator-or-text 4
other 6
infra-related 4
81
Sprint #5 (Erxian) started today

46. ● PRs merged (19)
○ Enhancements 14
○ Bug fixes 5
● Highlights
○ #319 Provided detailed steps for uploading the appliance to RHV.
○ #313 Updated the instructions on adding RHV providers for fine.
○ #312 Updated the instructions on manually uploading the appliance to RHV.
○ #311 Updated appliance_console_cli options for fine.
○ #310 Updated internal database setup and configuration steps for fine.
○ #307 Added instructions on creating Ansible Playbook service catalog items.
○ #306 Added instructions on creating Ansible Tower service catalog items.
○ #305 Updated instructions on adding Ansible providers, and CRUD operations.
Documentation
(Steve Bream)

47. Discussion
Sprint 59 Review - April 26