So you’ve developed an app in MongoDB Stitch? Now what? What is day-to-day use of  MongoDB Stitch really like? We’ll talk topics like multi-environment deployment (dev → test → production); logging; testing and timing; and how to best make MongoDB and Stitch work for your application.

2. Introduction
Who are we, what do we do? You have to learn the rules of the game.
And then you have to play better than
anyone else
--Albert Einstein

3. Us
► Karen Wilson
► Expert Architect
► BS Computer Science, Christopher Newport University
► Master’s in Information Technology, Virginia Tech
► AWS Certified Solutions Architect – Associate
► AWS Certified Developer - Associate
► Ed Bozovsky (Boz)
► Principle Architect
► BS Computer Science, University of Arkansas at Little Rock
► AWS Certified Solutions Architect – Associate
► AWS Certified Developer - Associate

4. Acxiom
MEASUREMENT
AND ANALYTICS
INTEGRATION
SERVICES
MANAGED
SERVICES
STRATEGY
SERVICES

5. Acxiom UDL

6. Acxiom Around the World

7. Acxiom & Stitch
OPERATIONAL DATA STORE DATA INGESTION

8. Why Stitch

9. Stitch
Proxy Webhooks
Values
Functions
Atlas
Data Streams
Delivery Streams
ODS
INGESTION

10. Testing & CI
A person who never made
a mistake never tried
anything new
-Albert Einstein
Never stop testing

11. Testing - CI
Pull Request
Nightly
578 Tests Cases Push Release

12. Push Release
USERS
VALUES
FUNCTIONS
SERVICES
WEBHOOKS
SERVICE RULES
DATABASE

13. Users
Exist?
https://stitch.mongodb.com/api/admin/v3.0/groups/${group_id}/apps/${app_id}/users
Create
https://stitch.mongodb.com/api/admin/v3.0/groups/${group_id}/apps/${app_id}/api_keys
YES NO

14. Values
https://stitch.mongodb.com/api/admin/v3.0/groups/${group_id}/apps/${app_id}/values
VS
GET
https://stitch.mongodb.com/api/admin/v3.0/groups/${group_id}/apps/${app_id}/values
POST

15. Functions
CONFIG
SOURCE SOURCE SOURCE
CONFIG CONFIG
EXCEPTION: VALIDATE_ & CLIENT_

16. Services
EXIST
Rules
Webhooks
Rules
Webhooks
GOTCHAS?
GCM
MONGODB
AWS
YES NO

17. lambdaLocal.execute({
event: testinput,
lambdaPath: path.join(__dirname, '../registration.js'),
timeoutMs: 3000
})
.then((result)=>{
console.log("RESULT: " + JSON.stringify(result));
expect(result[0]).to.equal('person.firstname');
expect(result[1]).to.equal('person.middle');
expect(result[2]).to.equal('person.lastname');
expect(result[3]).to.equal('address.street');
expect(result[4]).to.equal('address.city');
expect(result[5]).to.equal('address.state');
expect(result[6]).to.equal('address.zip');
});
describe('Test loading local values in JSON files with context.values.get', function() {
it('values property should exist', function() {
expect(context).to.have.property('values');
});
}let context = {
functions : {
execute(functionName,...args){
let importedFunction = require(context.srcDirectory + "functions/" + functionName);
return importedFunction(...args);
}
…
};
Testing - Unit
CONTEXT

18. Logging
When, where, why, how
The search for truth is more precious
than its possession
-- Albert Einstein

19. Logging – Audit Logging
127.0.0.1

20. Logging – Debug Logging
10
function LOG( level, message ) {
if ( ( loggingEnabled ) && ( level > systemLevel ) ) {
writeDocumentToCollection(level,message);
}
}
context.functions.execute( “LOG”, <level>, <message> );
values àsystem : {
logLevel : “DEBUG”
}
https://ods.myacxiom.com/v1/feedbacks?clientId=acme-cmdgl&debugLog=DEBUG

21. Logging – View Debug Logs

22. AWS Integrations
Back & Forth A little knowledge is dangerous. So is a lot
--Albert Einstein

23. AWS – Data Streams
????
?
VALUES
function : postProcess,
streamInfo : {
name : postProcessingStream,
region : us-west-2
}
const kinesis = context.services.get('aws').kinesis(awsRegion);
return kinesis.PutRecord({
Data: JSON.stringify(event),
StreamName: streamName,
PartitionKey: id,
})
.then((result) => {
context.functions.execute('do_timinglogs', 'awsKinesis', startTime);
return resolve(result);
})
.catch((error) => {
return reject(error);
});

24. AWS - Delivery Streams
One-time Setup Created Process

25. AWS Up Front
Proxy The definition of genius is
taking the complex and
making it simple.
- Albert Einstein

26. Proxy - Why
https://ods.myacxiom.com

27. Proxy - URL
Stitch URL
https://webhooks.mongodb-stitch.com/api/client/v2.0/app/acme-cmdgl/service/v1/incoming_webhook/feedbacks
Acxiom ODS Shortened URL
https://ods.myacxiom.com/v1/feedbacks?clientId=acme-cmdgl
And Even Shorter
https://inbound-udl.myacxiom.com/v1/inbound

28. Proxy – Get Put Post Delete

29. Proxy – JSON Validation
"path": "/api/v1/inbound/test/515791636893858",
"httpMethod": "POST",
"headers": {
"Authorization": "Bearer asdf-easd-38b3-4892-83d6-26b075bea08f",
"Content-Type": "application/json",
"Host": "ods.myacxiomtest.com",
"X-Forwarded-For": "76.213.42.186, 52.46.47.93",
"X-Forwarded-Port": "443",
"X-Forwarded-Proto": "https",
"X-Request-Id": "12345-3456-123456-2345-123563"
},
"queryStringParameters": {
"client": "acme-mdpgh",
"secret": "yeasureimprintingthis"
},
"body": "[{
"full" : "BOB SMITH”
"address": "234 STREET AVE", "APT 2",
"city" : "NEW YORK",
"state" : "NY",
"postalCode" : "09459",
"countryCode" : "USA"
}]"

30. Proxy – AJV Error Example
{
"error":
[ {
"keyword": "required",
"dataPath": "",
"schemaPath": "#/required",
"params": { "missingProperty": "activityTypeCode" },
"message": "should have required property 'activityTypeCode'"
},
{
"keyword": "type",
"dataPath": ".appliedTo.consumers[0].emails[0]",
"schemaPath": "#/properties/appliedTo/properties/consumers/items/properties/emails/items/type",
"params": {"type": "object" },
"message": "should be object"
} ],
"source": "proxy"
}

31. Proxy - API Jumps
LambdaAPI
Gateway
Acxiom Client Stitch Acxiom
login.acxiom.com
ods.acxiom.com
login.acxiom.com
webhooks.mongo-stitch.com
Proxy

32. Timing
The important thing is not to stop
questioning, curiosity has its own
reason for existing.
--Albert Einstein
It ran how long!?

33. Timing
API
feedback
API
timing
API
sources
by-pii
API
health
checks
APIsources

34. Timing – What should we track?
External API Calls
Proxy Operations
Client Logic

35. Timing – Client Logic (code)
return exitRtn(retval, 'client_exit1')
.then((retval) => { return exitRtn(retval, 'client_exit2'); })
.then((retval) => { return exitRtn(retval, 'client_exit3'); })
.then((retval) => { return exitRtn(retval, 'client_exit4'); })
.then((retval) => { return exitRtn(retval, 'client_exit5'); })
.then((retval) => { return exitRtn(retval, 'client_exit6'); })
.then((retval) => { return exitRtn(retval, 'client_exit7'); })
.then((retval) => { return exitRtn(retval, 'client_exit8'); })
.then((retval) => { return exitRtn(retval, 'client_exit9'); })
.then((retval) => { return exitRtn(retval, 'client_exit10'); })
.then((retval) => { return exitRtn(retval, 'remove_links'); })
.then((retval) => {
context.functions.execute('do_timinglogs', 'clientexits', startTime);
context.functions.execute('LOG_DEBUG', { source: client_exit_main.name, retval });
return retval;
})
.catch((err) => {
context.functions.execute('LOG_ERROR', { source: client_exit_main.name, err });
throw (`1125,Error returned from exit routine ${callRtn}`);
});

36. Timing - External API Calls

37. Timing - Proxy

38. Timing - Findings
What did we discover?
What can we improve?

39. Timing - Findings
Not everything needs tracking

40. Timing - Findings
Token authentication was
taking too much time

41. Timing - Findings
Random latency spikes
Normal calls take 1 second or less,
these were taking much longer
Spikes were caused by incorrect
routing logic the Acxiom Load
Balancers

42. Timing - Findings
Stitch was loading ODS Stitch code
from the incorrect region
Drew DiPalma’s team quickly isolated
the issue and fixed the Stitch code

43. Timing - Findings
When Stitch load balancers were overloaded
APIs were sent to incorrect regions
Normally we use:
webhooks.mongodb-stitch.com
Changed to use:
us-east-1.aws.webhooks.mongodb-stitch.com

44. Reporting
"Everything should be made as simple as
possible, but no simpler”
- Albert Einstein
Just the facts

45. Reporting

46. Reporting – Extracting API logs
Stitch Logs
MongoDB
Kibana Grafana

47. Reporting – Grafana Dashboard

48. Reporting – Tableau

49. Reporting - Alerting

50. MongoDB – Partners in Crime

51. q Testing and Continuous Integration
q Release automation
q Logging
q Data Streams
q YouTube from MW2018 “Pissing off IT and Delivery: A tale of 2 ODS’s”
q www.acxiom.com
q Proxy Capabilities
q Timing Logs
q Report Generation

52. Thank You