Meteos/Howto

This section explains what to do to increase the model accuracy.

Under Writing

step 1. Parse Dataset

Parsing dataset is one of the efficient way to increase model accuracy.

You can see example [here].

In this example, user eliminates exception data from dataset using filter method.

step 2. Tuning of model parameters

Parameter tuning is very important to increase the model accuracy. Parameters differs depending on prediction models.

(List of Parameters will be pasted here later.)

A "numIterations" is a common parameter except DecisionTreeModel.

A numIterations is a number of iterations run for each batch of data.

In general, you can increase the model accuracy by specifying larger number in numIterations. However, it takes more time for creating model.

You can specify model parameters in "model_params" section when creating model.

You can see a example [here].

step 3. Evaluate model accuracy

After creating prediction model, you can evaluate model using "meteos model-evaluation-create" method.

Before evaluating model, user have to create datasets for evaluation in advance.

In machine learning, user splits the dataset in general. One is for creating a prediction model, the other is for evaluating model.

step 4. Recreate model with new datasets

it's desirable for prediction models to increase the accuracy continuously.

you can re-create model with new datasets using "meteos model-recreate" method.

If you updated new datasets, you have to recreate a prediction model with new datasets to increase model accuracy continuously.

$ meteos model-list
+--------------------------------------+----------------------+-----------+----------------+----------------------------------------+
| id                                   | name                 | status    | type           | source_dataset_url                     |
+--------------------------------------+----------------------+-----------+----------------+----------------------------------------+
| 4ece0645-f9ed-4677-8548-b369f6b3835c | Movie Recommendation | available | Recommendation | swift://meteos/recommendation_data.txt |
+--------------------------------------+----------------------+-----------+----------------+----------------------------------------+

$ swift upload meteos recommendation_data.txt
recommendation_data.txt

$ cat sample/json/model_recreate.json
{
    "source_dataset_url": "swift://meteos/recommendation_data.txt",
    "swift_tenant": "demo",
    "swift_username": "demo",
    "swift_password": "nova"
}

$ meteos model-recreate 4ece0645-f9ed-4677-8548-b369f6b3835c --json ../json/model_recreate.json

$ meteos model-list
+--------------------------------------+----------------------+------------+----------------+----------------------------------------+
| id                                   | name                 | status     | type           | source_dataset_url                     |
+--------------------------------------+----------------------+------------+----------------+----------------------------------------+
| 4ece0645-f9ed-4677-8548-b369f6b3835c | Movie Recommendation | recreating | Recommendation | swift://meteos/recommendation_data.txt |
+--------------------------------------+----------------------+------------+----------------+----------------------------------------+

$ meteos model-list
+--------------------------------------+----------------------+-----------+----------------+----------------------------------------+
| id                                   | name                 | status    | type           | source_dataset_url                     |
+--------------------------------------+----------------------+-----------+----------------+----------------------------------------+
| 4ece0645-f9ed-4677-8548-b369f6b3835c | Movie Recommendation | available | Recommendation | swift://meteos/recommendation_data.txt |
+--------------------------------------+----------------------+-----------+----------------+----------------------------------------+