Machine Learning Process
Machine Learning is a field of Artificial Intelligence
Through algorithms, statistical models, and a "known" dataset, Machine Learning trains a computer system to make predictions, find anomalies, and group similar data samples, to create predictive models that will use with a set of "unknown" data
With the help of machine learning algorithms, Netflix has trained its system to recognize your viewing habits and suggest movies you might enjoy.
Machine Learning
Algorithms Statistical models
Known dataset
The outcome of predictive models that will be used with:
Un-Known dataset
Written by N Furlan – Data Engineer – www.linkedin.com/in/nfur/What is the training process of a machine learning system?
How do we train machine learning models?
A machine learning system's process comprises the following phrases of machine learning models:
• iterative preparation
• creation
• testing
• implementation
The process is sequential and iterative, so we can go back and forth, jumping from one step to another. The process requires adaptation, evaluation and finetuning.
We can outline the process in the following steps:
Step one: The Question
Step two: The Dataset: Gathering data, Data preparation, Data Exploration
Step three: Evaluation
Step four: The Deployment
Let's suppose we want to work on a Data science project.
The project usually starts with a question
1. We must use historical or active data collection or combined data to answer that question
2. The next step is gathering data relevant to the question we are working on.
The goal is to use data to prove or disprove a theory about what factors may impact the outcomes you want to understand.
Once we have the data, we must prepare them before interpreting it.
It is essential to understand the deep of the problem and the dataset we must handle.
Then we can explore the information contained therein.
Data Preparation and Data Exploration phrases are significant factors in data science projects
3. The next step of the process is creating models and evaluating performance
Machine learning algorithms map the relationships between variables. If their relationships describe reality, we can use them to accurately predict the values of the target variables and answer the question we started with.
Some algorithms perform better than others for certain kinds of problems.
Written by N Furlan – Data Engineer – www.linkedin.com/in/nfur/For the best result, we need to try several algorithms and compare the outcome of those models to historical values, then pick the best performer for the project we are working on.
4. The final step of the process is model interpretation and deployment. This phrase consists of the following:
• Using the model to simulate situations.
• Understand the relationships in your data.
You can make decisions using your new insights.
As soon as we answer a question, we may have to ask a new one, and we may have to repeat the process. Or the relationships modelled change requires another iteration of the process with new data that reflects the new reality.
Written by N Furlan – Data Engineer – www.linkedin.com/in/nfur/