A Session-Based Song Recommendation Approach Involving User Characterization along the Play Power-Law Distribution

Sánchez-Moreno, Diego; López Batista, Vivian F.; Muñoz Vicente, M. Dolores; Gil González, Ana B.; Moreno-García, María N.

doi:https://doi.org/10.1155/2020/7309453

Complexity

On this page

Abstract Introduction Related Work Conclusions Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2020 | Article ID 7309453 | https://doi.org/10.1155/2020/7309453

A Session-Based Song Recommendation Approach Involving User Characterization along the Play Power-Law Distribution

Diego Sánchez-Moreno,¹Vivian F. López Batista,¹M. Dolores Muñoz Vicente,¹Ana B. Gil González,¹and María N. Moreno-García¹

Academic Editor: Átila Bueno

Received02 Jan 2020

Revised21 Mar 2020

Accepted21 Apr 2020

Published02 Jun 2020

Abstract

In recent years, streaming music platforms have become very popular mainly due to the huge number of songs these systems make available to users. This enormous availability means that recommendation mechanisms that help users to select the music they like need to be incorporated. However, developing reliable recommender systems in the music field involves dealing with many problems, some of which are generic and widely studied in the literature while others are specific to this application domain and are therefore less well-known. This work is focused on two important issues that have not received much attention: managing gray-sheep users and obtaining implicit ratings. The first one is usually addressed by resorting to content information that is often difficult to obtain. The other drawback is related to the sparsity problem that arises when there are obstacles to gather explicit ratings. In this work, the referred shortcomings are addressed by means of a recommendation approach based on the users’ streaming sessions. The method is aimed at managing the well-known power-law probability distribution representing the listening behavior of users. This proposal improves the recommendation reliability of collaborative filtering methods while reducing the complexity of the procedures used so far to deal with the gray-sheep problem.

1. Introduction

In the digital era, where e-commerce and digital content distribution are so extended, recommender systems have become indispensable tools to help users to find the information, products, or services they are interested in. These systems are especially useful in the area of music streaming services, given the large volume of content they make available to listeners. Most streaming platforms have advanced filtering mechanisms and even music recommender systems. However, user satisfaction data indicate that their reliability is not very high [1, 2]. This may be due to numerous problems with the recommendation methods that occur irrespective of the application domain, as well as those specific to the field of music.

Collaborative filtering (CF) is the most extended recommendation approach and one of the most reliable. Its main characteristic is the use of ratings given by users to items to be recommended. The ratings are stored in a U × I matrix, where U is the number of users and I the number of items in the system. The GroupLens research system for Usenet news [3] was the first recommender system using CF, and Ringo [4] was one of the first and most popular music recommender systems based on CF.

There are two categories of CF methods: user-based and item-based. In the first, the active user receives the recommendations of items that have been positively rated by other users with similar tastes to him, that is, his/her nearest neighbors. These users have rated items in common with the active user in a similar way. Neighborhood can be computed by means of different similarity metrics. The most widely used ones are the Pearson correlation coefficient and cosine similarity [5]. Since the nearest neighbors are searched at recommendation time, user-based CF methods are also called memory-based. One of their main problems is scalability, which causes an exponential increment of the user response time as the number of users and the number of products in the system increase. In order to avoid this problem, item-based CF was proposed [4]. In this approach, rating-based similarities between items are computed before recommendation time, and then the active user receives suggestions of items similar to those he/she previously rated positively. This can be done since it is expected that new ratings given to items in large databases do not significantly change the similarity between them, especially for much rated items. This type of methods are also called as model-based methods since they make use of a model induced before the active user accesses the system. However, recommendations provided by item-based methods usually have less quality than those provided by user-based approaches. Therefore, they are indicated to be applied in large-scale systems where scalability is a serious problem. That is the case of Amazon, a very popular system where item-based models have been used [6].

The need for the explicit expression of the user’s personal preferences for items in the form of ratings is the cause of the other major drawback of CF: the sparsity problem, which arises when the rating matrix contains a large number of null elements. This means that the number of ratings obtained from the users is fewer than the number of ratings needed for prediction [7]. Matrix factorization approaches can be used to deal with this problem, but these methods have some disadvantages, such as the cost of building the models and the loss of information resulting from the dimensionality reduction, and these are not always compensated with a significant improvement of results [8]. Thus, in many cases, it is more effective to resort to implicit ratings that can be obtained from the time that users spend examining the items or from other data stored in log files; although in this case, it must be assumed that preferences derived from this information are usually not as reliable as the explicit ones.

Content-based methods are alternative approaches to CF that base recommendations on the similarity between items, as item-based techniques. Nevertheless, they do not need rating data since they make use of other features of the items for computing the similarity. These methods can be applied to address two well-known shortcomings of both user-based and item-based CF: early-rater (first-rater) and cold-start. The first drawback is observed when new products are introduced into the system. These items have never been rated; therefore, they cannot be recommended. The cold-start problem affects new users, who cannot receive recommendations because they have no or few evaluations about products. In these circumstances, item content is used to make recommendations of items similar to those that the user likes. Content-based methods are also used to address the gray-sheep problem suffered by users with unusual tastes, for whom it is very difficult to find neighbors [9].

Other proposals to deal with the abovementioned shortcomings of recommendation methods seek to build on the strengths of every category and avoid their weaknesses by means of hybrid approaches. This class of methods, which is currently the most extended, involves the combination of either different types of CF or CF with content-based techniques, among others [10].

Music recommender systems have other additional limitations that are specific to this application domain. On the one hand, explicit ratings are usually not available in the streaming platforms, so ratings are obtained from implicit feedback. This is the main difference between music and other domains: while items such as books and other products can be evaluated from their purchase records, musical items in the streaming platforms cannot be evaluated in that way because they are not purchased individually. Another difference is the way these items are consumed. While a book or a movie is generally read or watched by a given user once, a song is usually listened to many times. This quality can be used to derive ratings from the number of times that users play a given song or artist, but this is not a trivial task, given its characteristic frequency distribution. The frequency of plays of musical items (artists or songs) adopts a power-law distribution since high frequencies of plays are concentrated in very few items, while the remaining ones are part of the long tail of the curve [11]. Simple frequency functions usually used to transform plays into ratings are not suitable in this case.

The complexity of recommender systems has been increasing in recent years as they have evolved from initial CF or content-based systems to current systems that mostly use hybrid methods. In the latter, the level of complexity of the procedures and the information to be processed is much higher. While the basic collaborative filtering methods use simple algorithms such as k-nearest neighbors or matrix factorization, the hybrid methods combine these techniques with more complex machine learning algorithms. In addition, current systems do not only use explicit preference information but are able to infer that knowledge from user behavior and manage other users an item attributes. This usually requires, unlike traditional systems, collecting and processing not only static but also dynamic information, which entails greater difficulty.

The work presented in this paper deals with that complexity while addressing two important drawbacks of recommender systems: sparsity and the gray-sheep problem. Both are considered based on an analysis of the power-law distribution. Data sparsity is avoided by means of inducing implicit ratings, which is affected by that type of distribution. The gray-sheep problem, which has received little attention in the area of music recommendation, is closely related to the power-law distribution since gray-sheep users are those that listen to music that is mainly placed in the tail of the play frequency curve.

Taking into account the stated objectives, the main contributions of the work are the following:(i)A procedure for inferring user-song ratings from implicit feedback in which user sessions are considered(ii)A method to tackle the gray-sheep problem that involves the characterization of each user according to the play frequency of the songs he/she listen to

An important advantage of our proposal is the fact that it requires only information about the plays of songs by users, without the need for content information. This in turn leads to a reduction in the complexity of the methods used so far to make recommendations to users with unusual tastes.

The rest of the paper is organized as follows. Section 2 contains a brief description of related works. The approach proposed to improve CF-based recommendations is detailed in Section 3. Results and discussion are given in Section 4, and the last section of the paper is devoted to the conclusions.

The drawbacks of the recommendation methods have been the focus of many works in literature [12]. Gray-sheep, cold-start, and early-rater problems have been addressed mainly by making use of content-based approaches. The content information about musical items can be extracted from their metadata, such as title, artist, year, genre, or lyrics for songs and style, country, and other demographic data for artists. Recently, social tags given to items by users are also taken as content attributes of the items, and even biographies of the artists have been used to obtain content data [13]. Besides those high-level features, low-level audio features are also exploited by means of content-based methods in many works. Spectrum, rhythm, and harmony-conforming chord structure are used in [14] to determine music similarity. In [15], music is classified in melody styles as a preliminary step to learn user music preferences by mining the melody patterns from the music access behavior of the users. Pitch, tempo, loudness, and entropy features are taken in [16] to classify musical items. Metadata, including title, artist, genre, and the lyrics of a musical piece, are used as content information by the recommendation process. A clustering technique is proposed in [17] to group similar songs from audio features. The aim is to provide users with recommendations from the appropriate clusters according to their listening behavior. The cold-start problems are addressed in [13] by means of deep network architectures used to combine user feedback data with artist and track embeddings. These are learned from biographies and audio signals, respectively. In [18], tempo, timbre, and rhythm features, jointly with tags provided by users, are used in a method for recommending appropriate music for videos. Each video or music is represented as a linear combination of latent factors of their associated features, and this model is used to calculate similarities on new feature spaces. Low-level description of the music is also used in [19] for emotion recognition and genre classification. These two features are learned by means of a recurrent neural network and later used as input of a support vector machine (SVM) in order to improve its results against the use of the music original features as input.

Since content-based methods usually produce worse results than CF, hybrid approaches have been proposed for improving recommendation reliability while addressing some of the problems mentioned above [20–22]. They have also been used in the music application domain for the same purpose. In [23], unobservable user preferences are represented as a set of latent variables associated with ratings and content data, which are statistically estimated and introduced in a Bayesian network called a three-way aspect model. The hybrid proposal presented in [18] combines a content-based model for recommending unrated music, a collaboration algorithm for recommendations based on other users’ suggestions, and an emotion-based recommendation procedure that determines interesting music for users by computing the differences between user interests and musical emotions. A weighting system based on user listening behavior is used to combine the three methods. A questionnaire that users must fill out is necessary to discover their interests, which can be a drawback since users are not always willing to do so.

In the last years, social information is being incorporated into recommender models, either as additional attributes in CF or in hybrid recommender systems [24, 25]. In [26], topics associated with songs are induced from social tagging. Social tags assigned to songs are used in [27] to establish the similarity between them as well as to capture user preferences. Another more innovative use of social tagging is the inference of user expertise in order to find more trusted neighbors for CF [28]. Friendship relations between users of streaming platforms is a different type of social information that can be treated jointly with user preferences in order to improve music recommendations [29].

There are fewer works in the literature specifically focused on improving recommendations for the gray-sheep users, in spite of the fact that the rest of the users being affected by this problem, since it has been proven that the existence of a large number of individuals with unusual preferences might have an important impact in the recommendation quality of the entire community [30]. Content-based and hybrid methods, as previously described, can produce some improvement but are not usually very significant. Moreover, they require additional information that may not be available. Semantic web mining can also be used to solve gray-sheep and other typical problems of recommender systems. Semantic information is added to the existing data in order to formalize and classify product and user features. In this way, content-based models at different abstraction levels can be generated to provide recommendations based on those taxonomies. They can be combined with other approaches in order to improve recommendations [12, 31]. In [32], the authors make use of domain ontologies to classify users and items in a multilayered community of interests prior to the similarity computation. The main drawback of this type of method is the fact that they are not easily extendible since every application domain would involve the time-consuming task of defining a specific ontology. A different approach in this line is presented in [33], where a framework for semantic-aware recommendations is proposed. In this work, concepts are automatically extracted from heterogeneous information sources, and relations between concepts are established on the basis of temporal-spatial information. The procedures involved in the framework are complex and are defined for a specific application scenario. In general terms, the methods reported in the literature to address the gray-sheep problem are very complex.

Clustering is an alternative and simpler procedure to treat users with few neighbors [34]. In [30], an extensive review of recommender systems based on diverse clustering techniques is reported. The work also includes a new proposal involving the application of the k-means algorithm to generate clusters in order to detect the gray-sheep users and a recommendation procedure for them based on their profiles. In addition, a clustering-based collaborative filtering algorithm is used to give recommendations to the remaining users. They also analyze the effect of different distance metrics in the quality of the recommendations. In some works, the clustering technique is used to address the sparsity and gray-sheep problems at the same time since some authors consider that both problems are related. In [20, 35], fuzzy class association rules are induced from previously clustered data in order to assign more than one cluster to each user with different degrees of belonging. A simulated scenario for gray-sheep users proved the effectiveness of the method. The process, implemented in a tourist system, is not simple and requires user and items features. The Last.fm dataset is used in [36] to validate a hierarchical agglomerative clustering method for recommending resources in folksonomies, which considers the users’ current navigation context in cluster selection. As far as we know, most of the methods proposed for dealing with the gray-sheep problem make use of user and/or item attributes.

The sparsity problem, caused by the insufficient number of ratings, has been widely studied in the literature. Apart from content-based methods, there are two main approaches to deal with this drawback: matrix factorization and the use of implicit user feedback to derive ratings. Matrix factorization methods have the peculiarity that can be applied with both explicit and implicit ratings. They are procedures for dimensionality reduction that generate latent factors for each user and each item. The most extended technique in the area of recommender systems for factorizing the rating matrix is singular value decomposition (SVD) [37]. In some application domains, SVD yields more reliable recommendations than standard CF algorithms [38]. However, it has a high computational cost in large-scale systems; thus, less expensive SVD-based approaches, such as incremental SVD have been proposed [39]. Sparsity has also been addressed by means of other SVD-based techniques for dimensionality reduction as latent semantic indexing (LSI) [40] and principal and component analysis (PCA) [41].

In the music recommender area, there are some works in which matrix factorization-based procedures have been proposed. The proposal of [42] using weighted matrix factorization (WMF) with implicit ratings in recommender systems has been taken in [43] as a basis of their method for song recommendation where latent factors for a given song are predicted from its audio signal. In [44], WMF is also used with the same purpose but using the number of song plays as implicit feedback.

A way to address the sparsity problem when using implicit feedback is presented by Yu et al. [45]. A model that combines the Poisson factor model and the Bayesian personalized ranking is proposed to learn user preferences and item characteristics from the frequency of interactions between users and items. Implicit ratings are also usually obtained from purchase records. In [46], log files of a mobile web application are used to identify actions, such as purchases, prelistening, and clicks, in user sessions. This information regarding the purchasing behavior of users is aimed at obtaining implicit ratings. As stated previously, those data are not available when consuming music through streaming services; thus, the usual way of obtaining implicit feedback in that context is making use of the frequency of plays. This information is provided in the Last.fm database and used in some research works where different functions for transforming it into ratings are proposed [47, 48]. However, other kinds of information can be used, such as the access history of users, which is taken in [16] to obtain user interests in a music recommendation system based on music and user groupings. In [49], a session-based collaborative filtering recommendation method is proposed, which can be used to recommend the next song the user should listen to, even when no previous user rating data are available. This method uses the items selected in the active user session to find the most similar sessions and generate the recommendation from them.

3. Improving CF Approaches for Song Recommendation

The main advantage of the proposal for recommending songs presented here is the fact that only data about the plays of the songs by each user are required. Since this information is collected by the streaming systems in an easy and regular way, some drawbacks regarding the need to acquire additional data, as explicit ratings, music metadata, or audio features, are avoided. The work is the continuation of a previous proposal for artist recommendation [50] and another preliminary study [51], which has been extended and adapted for recommending songs. The improvement of results compared to the main CF methods is achieved by focusing on two major aspects: a new way of obtaining implicit ratings from user sessions and the characterization of users according to the place of the songs played by them in the power-law distribution of play frequency. These approaches are ways of dealing with sparsity and gray-sheep problems, respectively. The first objective is achieved by significantly increasing the number of ratings about songs since every song played by the user will have an associated implicit evaluation. The second is addressed by characterizing each user according to their gray-sheep level.

The procedure for computing implicit ratings differs from other approaches based on frequency functions since not only the count of plays is used but also the position of the song in the user sessions. Concerning the gray-sheep treatment, there is no need for content information or the creation of clusters for different types of users, as most of the proposals in the literature do. The recommendation method is applied in the same way to all users in the system, taking into account an additional attribute that characterizes them according to the degree to which their tastes are unusual.

3.1. Computing Implicit Ratings from User Sessions

Obtaining both the implicit and explicit ratings required by collaborative filtering methods always requires some types of user interaction. In the case of explicit ratings, users assign a value to items that indicate the degree to which he or she has liked that product, while implicit ratings are usually obtained from other kinds of interactions with items, such as the purchase of a product and the time spent viewing information about the item. Therefore, in both cases, the only available information on the preferences is about those items that have been the object of the user interaction. The aim of the recommendations is to help users discover products or services that they do not know and that they might like. Thus, only items that the user has not previously interacted with are recommended.

Traditional ways of obtaining implicit ratings for items from purchase records, clicks, or timestamp information are not possible in the context of our study since the interaction mode of users with songs in music streaming platforms is quite different from interaction with other items in other kinds of systems. Usually, binary values or simple frequency functions of plays are used to derive preferences from user implicit feedback. However, in this work, we propose a more complex model to infer users’ interests from their behavior in a more reliable way.

This approach takes into account the sessions in which users play songs through the streaming services as well as a play frequency percentile function in the calculation of the ratings. Although all the songs played by the user have been chosen by him/her, the method is based on the fact that the first song in a user session is important since it has a higher probability of being a direct choice of the user at this time than the songs in other positions.

A user session is considered a period in which the user is listening to songs without interruption. It consists of songs that are played in a particular order; thus, it can be characterized as a Markov chain where initial probabilities are proportional to the number of times a given state was visited. In our case, the problem is simplified since only the start and nonstart of a session is considered for the songs belonging to a session. Therefore, we use the number of times for each user that each song was at the start of the session and the number of times that each song was not at the start of a session to induce the ratings.

Let us consider a set of users and a set of songs where and represent a user and a song, respectively. In this way, in our method, the frequency function for a user i and a song j is computed as follows:where is the number of times the song was the start of the session for the user and is the number of times it was played in other positions of the sessions. α parameter is used to adjust the importance of each term of the equation.

Once the session-based frequency is computed, Pacula’s procedure [52] is applied to obtain the ratings. This method has proven to be more suitable in the context of artist recommendation when play frequencies have a clear power-law distribution since there are few highly played artists, and most of them have few plays. The same distribution is presented when songs are the target of the recommendations, so it is also indicated in this case.

The method is based on the assumption that a user likes more a song that he/she listens to more times than one that he/she listens to less times. Therefore, rating values are given in comparative terms for each user. The implicit rating for the user and the song is calculated from as follows.

Let us consider that songs played by the user are ordered by their frequency values for this user, and denotes the frequency of a song with rank , being k’ = 1 for the song having the highest frequency:

Then, the rating for a song with rank k is computed as a linear function of the frequency percentile:

The values of the ratings are real numbers in the interval (0, 4]. Unlike other item interaction-based approaches, where binary ratings are obtained based on whether or not interaction has occurred, this approach more closely resembles explicit ratings that are usually within a range of values, which can be integer or real.

The ratings calculated in that way are used in the collaborative filtering approach proposed in this work, but they also can be used in any CF method following the same procedure used when ratings are explicit.

3.2. User Characterization-Based CF Approach

In order to deal with the gray-sheep problem suffered by users with uncommon tastes, we propose a procedure for characterizing users according to the play frequency of the songs they listen to. As indicated, the frequency of plays of the songs follows a power-law distribution, also called “long tail” in the context of music recommender systems. Then, gray-sheep users are those that listen to very few played songs, which are placed at the end of the long tail. However, in our proposal, it is not necessary to identify those special users, but all users in the system are associated with a gray-sheep degree along the power-law distribution curve depending on the position on the curve where the songs they play are located.

The first step of the procedure for user characterization is to determine a coefficient for the songs that reflects their popularity. This is the listening coefficient, which is computed for each song from both the number of users who play it and the number of plays it has. It is important to take into account both aspects since this coefficient will be used to characterize users, and gray-sheep ones are distinguished by having few neighbors.

For the set of users and the set of songs , the number of times that user plays a song is denoted as . This information for all users and songs is represented by the matrix of plays where :

The listening coefficient for a song g_j is computed as indicated in the following equation:where is the number of users who play the song g_j, is the average number of users per song, and is the average number of plays per song of user i.

The coefficient captures the playing behavior of the users with respect to each song: first, in the form of proportion of users who have listened to the song and second, in the form of number of plays of the song by a given user with respect to the average number of plays of this user. A normalized listening coefficient can be obtained by means of the following equation:

In the next step, the user playing coefficient (UPC) that characterizes users is computed from the listening coefficients of the songs they listen to:where a parameter that takes the value 1 if the song has been played by the user and the value 0 otherwise. is the total number of songs played by user . Users with high values of UPC have preferences in common with many others, while those with low values would be gray-sheep users.

Both user-playing coefficients and session-based implicit rating are needed for the next step that involves the CF method proposed in this work and described in the next subsection. Algorithm 1 describes the complete sequence of steps required for their calculation.

(1)	,
(2)
(3)
(4)	Set value
(5)	fordo
(6)	fordo
(7)
(8)	end for
(9)	end for
(10)	for do
(11)
(12)
(13)	fordo
(14)	Set value
(15)
(16)	end for
(17)	end for
(18)
(19)	for do
(20)
(21)
(22)	end for
(23)
(24)
(25)	for do
(26)
(27)
(28)
(29)	end for
(30)	for do
(31)
(32)
(33)	end for
(34)	for do
(35)
(36)	end for
(37)	,
(38)	Output: R and UPC

3.3. Incorporating UPC to User-Based CF

In user-based collaborative filtering, active users receive recommendations of items liked by their nearest neighbors. Two users are defined as neighbors if they have some items in common that they have rated with close scores. In the context of our work, users who like the same songs would have similar ratings and would, therefore, be neighbors.

For the set U of m users and the set G of n songs, there is a list of ratings for each user u_i that user has given to a subset of songs G_ui, where G_ui ⊆ G. Ratings are stored in a matrix called the rating matrix, where each element is the rating that a user u_i gives to a song :

When explicit ratings are used, this matrix usually has many null elements because users have rated a small subset of songs, in a way that the fewer the number of rated items, the sparser the matrix. As stated, this is an important problem inherent to CF methods that can be minimized by making use of implicit feedback. In this work, the rating matrix contains the session-based implicit ratings computed by means of equations (1)–(3), as described in Algorithm 1. Our proposal also requires the user playing coefficients for every user , whose computing procedure is included in the same algorithm.

In order to make recommendations to the active user u_a, it is necessary to find user neighbors. Among the metrics that can be applied to computer user similarity, the Pearson correlation coefficient and cosine similarity are the most frequently used in the field of recommender systems.

The Pearson correlation coefficient evaluates the linear relationship between two variables and is obtained from its covariance. This coefficient for the active user u_a and another user u_i is computed as follows:where r_aj and r_ij are the ratings of user u_a and user u_i for song , respectively, and and are the average ratings of user u_a and user u_i, respectively. The Pearson coefficient can represent inverse and direct correlation with its values in the interval [−1, 1], where the value 0 corresponds to the absence of correlation.

Another commonly used similarity metric is cosine, which is given by the dot product of the vectors representing the preferences of two given users, u_a and u_i in the Euclidean space. The cosine similarity (CS) between those users is computed according to equation (10), where and are the vectors containing the implicit ratings for songs corresponding to users u_a and u_i, respectively:

This is the metric used in our approach since it can be used to compute similarity from other user attributes in addition to ratings. The additional attribute incorporated at this point is the user playing coefficient, , which influences the search result of the k-nearest neighbors. To do this, an attribute-aware weighted user-based K-NN approach was applied [53]. Specifically, the implementation is provided by the recommender extension of RapidMiner [54, 55]. The resulting weighted similarity () between a user and the active user, along with their ratings, is used to predict the rating that a given user would assign to a song that he/she has not played yet, by means of equation (11) [56]. Only the k-nearest neighbors, that is, those with the highest similarity values, will be taken into account to make the predictions:

The results of applying this proposal have been compared to those provided by other CF methods. They are analyzed in the next section.

4. Comparative Evaluation of the Proposal versus Other CF Methods

In order to validate the recommendation approach, a comparative study was conducted in which this proposal and other widely used CF methods were applied to a dataset containing real data collected by Oscar Celma (https://www.upf.edu/web/mtg/lastfm360k) from the Last.fm streaming platform. Only information concerning the play of songs by users was used in the study. Specifically, 420,209 records corresponding to 86,000 songs played by 53 users over two years were processed. Each of them consisted of the user ID, the song, and timestamp when the song was played.

The first step of the preprocessing process was to establish user sessions and place the songs played in each session in the order in which they were listened to. We considered a user inactivity period longer than 15 minutes as the mark of the end of a session. Then, the first play after that period was the indication of the start of a new session. After determining the sessions, the second step was to compute implicit ratings from the count of plays in each session and the number of times that each song was the start of the session for each user.

In order to compare our proposal based on sessions to the classical implicit ratings calculation based on the frequency of plays, we applied both methods. For the first, we reported the results obtained for three values of the alpha parameter. In the second, Pacula's method was used to calculate the ratings from the simple play count, without considering sessions. Basic and matrix factorization CF methods were tested to check whether the new rating computation procedure succeeded in increasing the reliability of the recommendations. One of these methods was K-nearest neighbor (K-NN) which is extensively used in the implementation of recommender systems. We tested user-based K-NN using both cosine and Pearson similarity measures for determining the neighborhood of K users who have preferences most similar to those of the active user. The number of K neighbors was set to 5 since it provided the best results in the experiments. Although it may seem insufficient to make the predictions, this number of neighbors has been successfully used in other work in the same field of application [8]. In addition, two matrix factorization methods were applied, the basic technique and a variant called biased matrix factorization that incorporates user and item regularization parameters. Ten-fold cross-validation was performed to evaluate the results, and the metrics used were RMSE (root-mean-square error), MAE (mean absolute error), and NMAE (normalized mean absolute error).

Figure 1 shows the error rates of the K-NN output for the cosine distance and Pearson coefficient. The results of matrix factorization methods are shown in Figure 2. We can see that the error rates decrease for all the methods when the session-based approach is used, especially with . This difference is significantly greater in the case of matrix factorization methods, which yielded worse results than k-NN. However, the NMAE reduction achieved with session-based ratings () versus play count-based rating is 17.12% and 16.08% for K-NN with cosine similarity and Pearson coefficient, respectively; the reduction versus matrix factorization (MF) and biased matrix factorization (BMF) is 37.56% and 24.43%, respectively.

Once the method for obtaining the ratings was validated, we checked the impact of introducing user characterization in CF. User playing coefficients, which characterize the degree in which a specific user is a gray-sheep, were computed according to the procedure described in Section 3.2. These coefficients were discretized before applying the proposed CF method aimed at improving efficiency. The results for different numbers of bins were analyzed to obtain the optimal partition. As expected, the errors decreased as the number of intervals increased, tending to stabilize at 300 bins. Thus, this was the number of bins chosen to conduct the experiments. Discretized coefficients obtained for every user u_i were used in the user-based K-NN algorithm as an additional attribute to compute user similarity, making use of the cosine measure, as described in Section 3.3. This approach that we call “user attribute K-NN UPC” was also tested with ratings based on play count and ratings based on sessions for three different values of α equations (1)–(3) and its results compared to those provided by the CF methods tested above. Table 1 shows the detailed results of all these methods.

One of the main conclusions obtained from the table is the confirmation that the session-based rating with α = 0.7 provides the best results. Another observation regarding the metric values in the table is the more significant error reduction for MAE than for RMSE. It is known that MAE is a linear score that is not as sensitive to outliers as RMSE, which further penalizes large errors. Therefore, the smaller decreasing of RMSE values may be due to the fact that there could be some predictions where the deviation from the actual value is significantly higher than the majority, both when using our proposal and the other methods. This can mask the improvement of the rest of the predictions.

From the analysis of the table, we can also derive that the lowest error rates occur with the new UPC-based method, regardless of the type of rating used. Figures 3–5 representing RMSE, MAE, and NMAE, respectively, allow us to visualize jointly both facts. It can be seen that the line representing the user attribute K-NN UPC method is in the lowest position, and the lowest points of all the lines representing the methods are those corresponding to the session-based ratings with α = 0.7.

In order to get an idea of the improvement achieved with the proposed approaches, we can compare the NMAE result of user attribute K-NN UPC with session-based ratings (α = 0.7) to both the best and the worst NMAE result of the other CF methods using classical play count-based rating. NMAE was reduced by 20.28% with respect to the best, user K-NN with Pearson coefficient, and by 42,64% with respect to the worst, matrix factorization. Differences are also important, comparing the UPC-based method to the rest of the methods when using session-based ratings (α = 0.7) in all of them. Figure 6 shows these differences. In this case, the improvements provided by user attribute K-NN UPC vary between 5.00% and 14.29%.

5. Conclusions

Sparsity and gray-sheep problems are two of the main reasons CF methods do not provide the reliability required in some recommendation systems. Both have been addressed in many works in the literature, although in the field of music, they have been less studied, especially the second. This is a major drawback because some of the proposed solutions are difficult to implement in this application domain. On the one hand, the way of obtaining implicit feedback in streaming services is totally different from other web applications due, among other reasons, to the fact that there are no individualized purchase records of songs, and the mode of consuming music is different from the consumption of other items. On the other hand, most of the proposals to deal with the problems of sparsity and gray-sheep, particularly with the latter, make use of content information that is difficult to obtain and that, in many cases, does not lead to the expected results.

In this work, an approach to improve recommendation reliability in the context of music streaming services is presented. Its main value is to address implicit rating computation and user characterization only from the play timestamp of the songs, information that is regularly collected by streaming platforms. The procedure proposed in this work for obtaining the ratings differs from most of the methods, that generally use play counts, because this procedure is based on user sessions. Furthermore, a new way of managing gray-sheep users based on the long tail distribution is presented. The results show a significant improvement of recommendation reliability over traditional CF and matrix factorization methods.

Data Availability

The dataset used in the study is publicly available for noncommercial use at https://www.upf.edu/web/mtg/lastfm360k.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This research has been supported by the Department of Education of the Junta de Castilla y León, Spain (ORDEN EDU/667/2019 ‐ Grant ID: SA064G19).

References

M. Iqbal, “Spotify usage and revenue statistics,” March 2020, https://www.businessofapps.com/data/spotify-statistics/#3.
View at: Google Scholar
I. Kamehkhosh, G. Bonnin, and D. Jannach, “Effects of recommendations on the playlist creation behavior of users,” User Modeling and User-Adapted Interaction, vol. 2019, 2019.
View at: Publisher Site | Google Scholar
P. Resnik, “Semantic similarity in a taxonomy: an information based measure and its application to problems of ambiguity in natural language,” Journal of Artificial Intelligence, vol. 11, pp. 94–130, 1999.
View at: Publisher Site | Google Scholar
B. Sarwar, G. Karypis, J. A. Konstan, and J. Riedl, “Item-based collaborative filtering recommendation algorithm,” in Proceedings of the Tenth International World Wide Web Conference, pp. 285–295, ACM, Hong Kong, China, May 2001.
View at: Google Scholar
J. S. Breese, D. Heckerman, and C. Kadie, “Empirical analysis of predictive algorithms for collaborative filtering,” Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann Publishers Inc., pp. 43–52.
View at: Google Scholar
G. Linden, B. Smith, and J. York, “Amazon.com recommendations: item-to-item collaborative filtering,” IEEE Internet Computing, vol. 7, no. 1, pp. 76–80, 2003.
View at: Publisher Site | Google Scholar
J. P. Lucas, A. Laurent, M. N. Moreno, and M. Teisseire, “A fuzzy associative classification approach for recommender systems,” International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 20, no. 4, pp. 579–617, 2012.
View at: Publisher Site | Google Scholar
D. Sánchez-Moreno, Y. Zheng, and M. N. Moreno-García, “Incorporating time dynamics and implicit feedback into music recommender systems,” in Proceedings of the 17th IEEE/WIC/ACM International Conference on Web Intelligence (WI’18), pp. 580–585, Santiago, Chile, December 2018.
View at: Google Scholar
M. Claypool, A. Gokhale, T. Mir, P. Murnikov, D. Netes, and M. Sartin, “Combining content-based and collaborative filters in an online newspaper,” in Proceedings of ACM SIGIR Workshop on Recommender Systems, ACM, Berkeley, CA, USA, September 1999.
View at: Google Scholar
X. Su and T. M. Khoshgoftaar, “A survey of collaborative filtering techniques,” Advances in Artificial Intelligence, vol. 2009, Article ID 421425, 19 pages, 2009.
View at: Publisher Site | Google Scholar
O. Celma, Music Recommendation and Discovery: The Long Tail, Long Fail, and Long Play in the Digital Music Space, Springer, Berlín, Germany, 2010.
M. N. Moreno, S. Segrera, V. F. López, M. D. Muñoz, and Á. L. Sánchez, “Web mining based framework for solving usual problems in recommender systems. A case study for movies’ recommendation,” Neurocomputing, vol. 176, pp. 72–80, 2016.
View at: Publisher Site | Google Scholar
S. Oramas, O. Nieto, M. Sordo, and X. Serra, “A deep multimodal approach for cold-start music recommendation,” in Proceedings of the 2nd Workshop on Deep Learning for Recommender Systems, pp. 32–37, Como Italy, August 2017.
View at: Google Scholar
G. Tzanetakis and P. Cook, “Musical genre classification of audio signals,” IEEE Transactions on Speech and Audio Processing, vol. 10, no. 5, pp. 293–302, 2002.
View at: Publisher Site | Google Scholar
F. F. Kuo and M. K. Shan, “A personalized music filtering system based on melody style classification,” in Proceedings of the IEEE International Conference on Data Mining, pp. 649–652, Maebashi City, Japan, December 2002.
View at: Google Scholar
H.-C. Chen and A. L. P. Chen, “A music recommendation system based on music and user grouping,” Journal of Intelligent Information Systems, vol. 24, no. 2-3, pp. 113–132, 2005.
View at: Publisher Site | Google Scholar
Z. Cataltepe and B. Altinel, “Music recommendation based on adaptive feature and user grouping,” in Proceedings of 22nd International Symposium on Computer and Information Sciences, pp. 1–6, Ankara, Turkey, November 2007.
View at: Google Scholar
C.-C. Lu and V. S. Tseng, “A novel method for personalized music recommendation,” Expert Systems with Applications, vol. 36, no. 6, pp. 10035–10044, 2009.
View at: Publisher Site | Google Scholar
J. Jakubik and H. Kwaśnicka, “Similarity-based summarization of music files for Support vector machines,” Complexity, vol. 2018, Article ID 1935938, p. 10, 2018.
View at: Publisher Site | Google Scholar
J. P. Lucas, N. Luz, M. N. Moreno, R. Anacleto, A. Almeida Figueiredo, and C. Martins, “A hybrid recommendation approach for a tourism system,” Expert Systems with Applications, vol. 40, no. 9, pp. 3532–3550, 2013.
View at: Publisher Site | Google Scholar
P. Melville, R. J. Mooney, and R. Nagarajan, “Content boosted collaborative filtering for improved recommendations,” in Proceedings of the 18th National Conference on Artificial Intelligence, pp. 187–192, Edmonton, Canada, July-August 2002.
View at: Google Scholar
X. Su, R. Greiner, T. M. Khoshgoftaar, and X. Zhu, “Hybrid collaborative filtering algorithms using a mixture of experts,” in Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence, pp. 645–649, Silicon Valley, CA, USA, November 2007.
View at: Google Scholar
K. Yoshii, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, “Hybrid collaborative and content-based music recommendation using probabilistic model with latent user preferences,” in Proceedings of the 7th International Conference on Music Information Retrieval, pp. 296–301, University of Victoria, Victoria, Canada, October 2006.
View at: Google Scholar
S. Deng, D. Wang, X. Li, and G. Xu, “Exploring user emotion in microblogs for music recommendation,” Expert Systems with Applications, vol. 42, no. 23, pp. 9284–9293, 2015.
View at: Publisher Site | Google Scholar
Z. Hyung, K. Lee, and K. Lee, “Music recommendation using text analysis on song requests to radio stations,” Expert Systems with Applications, vol. 41, no. 5, pp. 2608–2618, 2014.
View at: Publisher Site | Google Scholar
N. Hariri, B. Mobasher, and R. Burke, “Context-aware music recommendation based on latent topic sequential patterns,” in Proceedings of the Sixth ACM Conference on Recommender Systems, pp. 131–138, Dublin, Ireland, September 2012.
View at: Google Scholar
J.-H. Su, W.-Y. Chang, and V. S. Tseng, “Personalized music recommendation by mining social media tags,” Procedia Computer Science, vol. 22, pp. 303–312, 2013.
View at: Publisher Site | Google Scholar
D. Sánchez-Moreno, M. N. Moreno-García, N. Sonboli, B. Mobasher, and R. Burke, “Inferring user expertise from social tagging in music recommender systems for streaming services,” in Hybrid Artificial Intelligence Systems, Lecture Notes in Artificial Intelligence, F. de Cos, Ed., pp. 39–49, Springer, Berlin, Germany, 2018.
View at: Google Scholar
D. Sánchez-Moreno, J. Pérez-Marcos, A. B. Gil, V. F. López, and M. N. Moreno-García, “Social influence-based similarity measures for user-user collaborative filtering applied to music recommendation,” in Proceedings of the 15th International Conference Distributed Computing and Artificial Intelligence, Special Sessions, Advances in Intelligent Systems and Computing, S. Rodríguez, Ed., vol. 801, pp. 1–8, Springer, Toledo, Spain, June 2018.
View at: Google Scholar
M. A. Ghazanfar and A. Prügel-Bennett, “Leveraging clustering approaches to solve the gray-sheep users problem in recommender systems,” Expert Systems with Applications, vol. 41, no. 7, pp. 3261–3275, 2014.
View at: Publisher Site | Google Scholar
H.-N. Kim, A. Alkhaldi, A. El Saddik, and G.-S. Jo, “Collaborative user modeling with user-generated tags for social recommender systems,” Expert Systems with Applications, vol. 38, no. 7, pp. 8488–8496, 2011.
View at: Publisher Site | Google Scholar
I. Cantador, A. Bellogín, and P. Castells, “A multilayer ontology-based hybrid recommendation model,” AI Communications, vol. 21, no. 2-3, pp. 203–210, 2008.
View at: Publisher Site | Google Scholar
F. Wang, L. Hu, R. Sun, J. Hu, and K. Zhao, “SRMCS: a semantic-aware recommendation framework for mobile crowd sensing,” Information Sciences, vol. 433-434, pp. 333–345, 2018.
View at: Publisher Site | Google Scholar
H. Ghorbani and A. H. Novin, “An introduction on separating gray-sheep users in personalized recommender systems using clustering solution,” International Journal of Computer Science and Software Engineering, vol. 5, pp. 14–18, 2016.
View at: Google Scholar
J. P. Lucas, S. Segrera, and M. N. Moreno, “Making use of associative classifiers in order to alleviate typical drawbacks in recommender systems,” Expert Systems with Applications, vol. 39, pp. 1273–1283, 2012.
View at: Publisher Site | Google Scholar
A. Shepitsen, J. Gemmell, B. Mobasher, and R. Burke, “Personalized recommendation in social tagging systems using hierarchical clustering,” in Proceedings of the 2008 ACM Conference on Recommender Systems, pp. 259–266, ACM, Lausanne, Switzerland, October 2008.
View at: Google Scholar
D. Billsus and M. Pazzani, “Learning collaborative information filters,” in Proceedings of the 15th International Conference on Machine Learning (ICML’98), pp. 46–54, Morgan Kaufmann, Madison, WI, USA, July 1998.
View at: Google Scholar
B. M. Sarwar, G. Karypis, J. A. Konstan, and J. Riedl, “Application of dimensionality reduction in recommender system-A case study,” in Proceedings of ACM Web-Mining for Ecommerce Workshop, Boston, MA, USA, August 2000.
View at: Google Scholar
B. M. Sarwar, G. Karypis, J. A. Konstan, and J. Riedl, “Incremental singular value decomposition algorithms for highly scalable recommender systems,” in Proceedings of 5th International Conference in Computers and Information Technology, ACM, Dhaka, Bangladesh, December 2002.
View at: Google Scholar
T. Hofmann, “Latent semantic models for collaborative filtering,” ACM Transactions on Information Systems (TOIS), vol. 22, no. 1, pp. 89–115, 2004.
View at: Publisher Site | Google Scholar
K. Goldberg, T. Roeder, D. Gupta, and C. Perkins, “Eigentaste: a constant time collaborative filtering algorithm,” Information Retrieval, vol. 4, no. 2, pp. 133–151, 2001.
View at: Publisher Site | Google Scholar
Y. Hu, Y. Koren, and C. Volinsky, “Collaborative filtering for implicit feedback datasets,” in Proceedings of Eighth IEEE International Conference on Data Mining, pp. 263–272, IEEE, Pisa, Italy, December 2008.
View at: Google Scholar
A. Van den Oord, S. Dieleman, and B. Schrauwen, “Deep content-based music recommendation,” Advances in Neural Information Processing Systems, vol. 26, pp. 2643–2651, 2013.
View at: Google Scholar
C. Koh and T. Ko, “Deep content-based music recommendation,” in Proceedings of the Advances in Neural Information Processing Systems, 26. Presented at the Neural Information Processing Systems Conference (NIPS 2013), Neural Information Processing Systems Foundation (NIPS), Lake Tahoe, NV, USA, December 2013.
View at: Google Scholar
Y. Yu, L. Zhang, C. Wang, R. Gao, W. Zhao, and J. Jiang, “Neural personalized ranking via Poisson factor model for item recommendation,” Complexity, vol. 2019, Article ID 3563674, p. 16, 2019.
View at: Publisher Site | Google Scholar
S. K. Lee, Y. H. Cho, and S. H. Kim, “Collaborative filtering with ordinal scale-based implicit ratings for mobile music recommendations,” Information Sciences, vol. 180, no. 11, pp. 2142–2155, 2010.
View at: Publisher Site | Google Scholar
K. Lee and K. Lee, “Escaping your comfort zone: a graph-based recommender system for finding novel recommendations among relevant items,” Expert Systems with Applications, vol. 42, no. 10, pp. 4851–4858, 2015.
View at: Publisher Site | Google Scholar
S. Vargas and P. Castells, “Rank and relevance in novelty and diversity metrics for recommender systems,” in Proceedings of the Fifth ACM Conference on Recommender Systems, pp. 109–116, ACM, Chicago, IL, USA, October 2011.
View at: Google Scholar
S. E. Park, S. Lee, and S. Lee, “Session-based collaborative filtering for predicting the next song,” in Proceedings of First ACIS/JNU International Conference on Computers, Networks, Systems and Industrial Engineering, pp. 353–358, Jeju Island, Korea, May 2011.
View at: Google Scholar
D. Sánchez-Moreno, A. B. Gil González, M. D. Muñoz Vicente, V. F. López Batista, and M. N. Moreno García, “A collaborative filtering method for music recommendation using playing coefficients for artists and users,” Expert Systems with Applications, vol. 66, pp. 234–244, 2016.
View at: Publisher Site | Google Scholar
D. Sánchez-Moreno, A. B. Gil, M. D. Muñoz, V. F. López, and M. N. Moreno, “Recommendation of songs in music streaming services. Dealing with sparsity and gray sheep problems,” in Proceedings of the Trends in Cyber-Physical Multi-Agent Systems. The PAAMS Collection—15th International Conference, PAAMS 2017. Advances in Intelligent Systems and Computing Series, F. de la Prieta, Z. Vale, L. Antunes et al., Eds., vol. 619, pp. 206–213, Springer, Porto, Portugal, June 2017.
View at: Google Scholar
M. Pacula, “A matrix factorization algorithm for music recommendation using implicit user feedback,” March 2020, http://www.mpacula.com/publications/lastfm.pdf.
View at: Google Scholar
K. Tso and L. Schmidt-Thieme, “Attribute-aware collaborative filtering,” in From Data and Information Analysis to Knowledge Engineering. Studies in Classification, Data Analysis, and Knowledge Organization, M. Spiliopoulou, R. Kruse, C. Borgelt, A. Nürnberger, and W. Gaul, Eds., Springer, Berlin, Heidelberg, 2006.
View at: Google Scholar
M. Mihelčić, N. Antulov-Fantulin, M. Bošnjak, and T. Šmuc, “Extending RapidMiner with recommender systems algorithms,” in Proceedings of the 3rd RapidMiner Community Meeting and Conference (RCOMM 2012), pp. 63–74, Shaker Verlag, Budapest, Hungary, August 2012.
View at: Google Scholar
M. Mihelčić, M. Bošnjak, N. Antulov-Fantulin, and T. Šmuc, “Constructing recommender systems in RapidMiner,” in RapidMiner. Data Mining Use Cases and Business Analytics Applications, M. Hofmann and R. Klinkenberg, Eds., pp. 119–143, CRC Press, Boca Raton, FL, USA, 2014.
View at: Google Scholar
C. C. Aggarwal, Recommender Systems, Springer, Berlin, Germany, 2016.

Copyright

Copyright © 2020 Diego Sánchez-Moreno et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1092

Downloads

969

Citations

Complexity

A Session-Based Song Recommendation Approach Involving User Characterization along the Play Power-Law Distribution

Abstract

1. Introduction

2. Related Work

3. Improving CF Approaches for Song Recommendation

3.1. Computing Implicit Ratings from User Sessions

3.2. User Characterization-Based CF Approach

3.3. Incorporating UPC to User-Based CF

4. Comparative Evaluation of the Proposal versus Other CF Methods

5. Conclusions

Data Availability

Conflicts of Interest

Acknowledgments

References

Copyright