Big picture outline of architectural components in a pipeline. General flow of processing for text based machine learning solutions. This can be generalized to other solutions as well

2. Prediction
Model for
Predictions
Machine has learned
and can predict within a
range of accuracy
Data Aggregation
Data is homogenized and
collected in a central system
Aggregation
Sources
Multiple Disparate Data
Sources
Source maybe database, web,
files or combination of these
Bag Of
Words
(Dataset)
Feature Engineering
Interesting text is extracted +
weighed + labeled
Machine
Learning
Apply Machine
Learning
Various algorithms,
libraries (NLP/NLU)
maybe used, intuition
developed and learning
system finalized

3. •
•
–
–
–
–
–
–
Sources
Multiple Disparate Data
Sources
Source maybe database, web,
files or combination of these

4. •
•
•
Data Aggregation
Data is homogenized and collected in
a central system
Aggregation

5. •
•
•
•
Bag Of
Words
Feature Engineering
Interesting text is extracted +
weighed + labeled

6. •
•
•
•
•
Machine
Learning
Apply Machine
Learning
Various algorithms,
libraries (NLP/NLU)
maybe used, intuition
developed and learning
system finalized

7. •
•
Prediction
Model for
Predictions
Machine has learned
and can predict within a
range of accuracy