Large refactor

scenarios/README.md

@@ -1,74 +1,16 @@
 # Recommendation System Scenarios
 
-On this section there is listed a number of business scenarios that are common in Recommendation Systems (RS).
+On this section there is listed a number of business scenarios that are common in Recommendation Systems.
 
 The list of scenarios are:
 
-* Ads
-* Entertainment
-* Food and restaurants
-* News
-* Retail
-* Travel
+* [Ads](ads)
+* [Entertainment](entertainment)
+* [Food and restaurants](food_and_restaurants)
+* [News and document]()
+* [Retail](retail)
+* [Travel](travel)
 
-## Types of Recommendation Systems
-
-Typically recommendation systems in retail can be divided into three categories:
-
-* Collaborative filtering: This type of recommendation system makes predictions of what might interest a person based on the taste of many other users. It assumes that if person X likes Snickers, and person Y likes Snickers and Milky Way, then person X might like Milky Way as well.
-
-* Content-based filtering: This type of recommendation system focuses on the products themselves and recommends other products that have similar attributes. Content-based filtering relies on the characteristics of the products themselves, so it doesn’t rely on other users to interact with the products before making a recommendation.
-
-* Hybrid filtering: This type of recommendation system can implement a combination fo any two of the above systems.
-
-## Data in Recommendation Systems
-
-### Data types
-
-* Explicit interactions:
-
-* Implicit interactions:
-
-* Knowledge graph data:
-
-* User features:
-
-* Item features:
-
-### Considerations about data size
-
-The size of the data is important when designing the system...
-
-
-## Metrics
-
-In RS, there are two types of metrics: offline and online metrics.
-
-### Machine learning metrics (offline metrics)
-
-In Recommenders, offine metrics implementation for python are found on [python_evaluation.py](https://github.com/microsoft/recommenders/blob/master/reco_utils/evaluation/python_evaluation.py) and those for PySpark are found on [spark_evaluation.py](https://github.com/microsoft/recommenders/blob/master/reco_utils/evaluation/spark_evaluation.py).
-
-Currently available metrics include:
-
-- Root Mean Squared Error
-- Mean Absolute Error
-- R<sup>2</sup>
-- Explained Variance
-- Precision at K
-- Recall at K
-- Normalized Discounted Cumulative Gain at K
-- Mean Average Precision at K
-- Area Under Curve
-- Logistic Loss
-
-
-### Business success metrics (online metrics)
-
-Online metrics are specific on the business scenario. More details can be found on each scenario folder.
-
-## Managing Cold Start Scenarios in Recommendation Systems
-
-....
 
 
 

scenarios/retail/README.md

@@ -1,6 +1,6 @@
 # Recommendation systems for Retail
 
-An increasing number of online companies are utilizing recommendation systems to increase user interaction and enrich shopping potential. Use cases of recommendation systems have been expanding rapidly across many aspects of eCommerce and online media over the last 4-5 years, and we expect this trend to continue.
+An increasing number of online companies are utilizing recommendation systems (RS) to increase user interaction and enrich shopping potential. Use cases of recommendation systems have been expanding rapidly across many aspects of eCommerce and online media over the last 4-5 years, and we expect this trend to continue.
 
 Companies across many different areas of enterprise are beginning to implement recommendation systems in an attempt to enhance their customer’s online purchasing experience, increase sales and retain customers. Business owners are recognizing potential in the fact that recommendation systems allow the collection of a huge amount of information relating to user’s behavior and their transactions within an enterprise. This information can then be systematically stored within user profiles to be used for future interactions.
 
@@ -15,11 +15,39 @@ The most common scenarios companies use are:
 * Recommended for you: The "Recommended for you" recommendation predicts the next product that a user is most likely to engage with or purchase, based on the shopping or viewing history of that user. This recommendation is typically used on the home page.
 
 
+## Data in Recommendation Systems
+
+### Data types
+
+In RS for retail there are typically the following types of data
+
+* Explicit interactions: When a user explicitly rate an item, typically between 1-5, the user is giving a value on the likeliness of the item. In retail, this kind of data is not very common.
+
+* Implicit interactions: Implicit interactions are views or clicks that show a certain interest of the user about a specific items. These kind of data is more common but it doesn't define the intention of the user as clearly as the explicit data.
+
+* User features: These include all information that define the user, some examples can be name, address, email, demographics, etc. 
+
+* Item features: These include information about the item, some examples can be SKU, description, brand, price, etc.
+
+* Knowledge graph data: ...
+
+### Considerations about data size
+
+The size of the data is important when designing the system...
+
+### Cold start scenarios
+
+Personalized recommender systems take advantage of users past history to make predictions. The cold start problem concerns the personalized recommendations for users with no or few past history (new users). Providing recommendations to users with small past history becomes a difficult problem for CF models because their learning and predictive ability is limited. Multiple research have been conducted in this direction using hybrid models. These models use auxiliary information (multimodal information, side information, etc.) to overcome the cold start problem.
+
+### Long tail products
+
+Typically, the shape of items interacted in retail follow a long tail distribution [1,2]. 
+
 ## Measuring Recommendation performance
 
 ### Machine learning metrics (offline metrics)
 
-Please [see the main metrics description]() for understanding machine learning metrics. 
+Offline metrics in RS are based on rating, ranking, classification or diversity. For learning more about offline metrics, see the [definitions available in Recommenders repository](../../examples/03_evaluate)
 
 ### Business success metrics (online metrics)
 
@@ -40,18 +68,21 @@ There is some literature about the relationship between offline and online metri
 
 ### Advanced A/B testing: online learning with VW
 
-## Challenges in Recommendation systems for Retail
+...
 
-* Cold start: Personalized recommender systems take advantage of users past history to make predictions. The cold start problem concerns the personalized recommendations for users with no or few past history (new users). Providing recommendations to users with small past history becomes a difficult problem for CF models because their learning and predictive ability is limited. Multiple research have been conducted in this direction using hybrid models. These models use auxiliary information (multimodal information, side information, etc.) to overcome the cold start problem.
+## Examples of end 2 end recommendation scenarios with Microsoft Recommenders
 
-* Long tail products:
+From a technical perspective, RS can be grouped in these categories [1]:
 
+* Collaborative filtering: This type of recommendation system makes predictions of what might interest a person based on the taste of many other users. It assumes that if person X likes Snickers, and person Y likes Snickers and Milky Way, then person X might like Milky Way as well. See the [list of examples in Recommenders repository](../../examples/02_model_collaborative_filtering).
 
+* Content-based filtering: This type of recommendation system focuses on the products themselves and recommends other products that have similar attributes. Content-based filtering relies on the characteristics of the products themselves, so it doesn’t rely on other users to interact with the products before making a recommendation. See the [list of examples in Recommenders repository](../../examples/02_model_content_based_filtering).
 
-## Building end 2 end recommendation scenarios with Microsoft Recommenders
+* Hybrid filtering: This type of recommendation system can implement a combination fo any two of the above systems. See the [list of examples in Recommenders repository](../../examples/02_model_hybrid).
 
-In the repository we have the following examples that can be used in retail
+* Knowledge-base: ...
 
+In the repository we have the following examples that can be used in retail
 
 | Scenario | Description | Algorithm | Implementation |
 |----------|-------------|-----------|----------------|
@@ -62,4 +93,8 @@ In the repository we have the following examples that can be used in retail
 
 ## References and resources
 
+[1] Aggarwal, Charu C. Recommender systems. Vol. 1. Cham: Springer International Publishing, 2016.
+[2]. Park, Yoon-Joo, and Alexander Tuzhilin. "The long tail of recommender systems and how to leverage it." In Proceedings of the 2008 ACM conference on Recommender systems, pp. 11-18. 2008. [Link to paper](http://people.stern.nyu.edu/atuzhili/pdf/Park-Tuzhilin-RecSys08-final.pdf).
+[3]. Armstrong, Robert. "The long tail: Why the future of business is selling less of more." Canadian Journal of Communication 33, no. 1 (2008). [Link to paper](https://www.cjc-online.ca/index.php/journal/article/view/1946/3141).
+
 sources: [1](https://emerj.com/ai-sector-overviews/use-cases-recommendation-systems/), [2](https://cloud.google.com/recommendations-ai/docs/placements), [3](https://www.researchgate.net/post/Can_anyone_explain_what_is_cold_start_problem_in_recommender_system)