Tag Archives: metrics

Posts related to metrics

Performance Metrics for Text Categorization

One of the most common and extensively studied knowledge extraction task is text categorization. Frequently customers ask how we evaluate the quality of the output of our categorization models, especially in scenarios where each document may belong to several categories.

The idea is to be able to keep track of changes in the continuous improvement cycle of models and know if those changes have been for good or bad, to commit or reject them.

This post gives answer to this question describing the metrics that we commonly adopt for model quality assessment, depending on the categorization scenario that we are facing.

 

Continue reading


Analyzig audience and opinion on live events for Social TV

By the end of June, we took part in the TVX 2014 international conference on interactive experiences for television and online video with a demo entitled “Numbat – Tracking Buzz and Sentiment for Second Screens”. On it we showed our work and expertise on social media analytics applied to television and live events, combining semantic analysis technologies and real-time data processing to get metrics on social audience and opinions about each feature of the live program or event.

Social TV is not only a continuously growing area, but also a thoroughly mature one, with dozens of companies interested in user interaction and social marketing. Social media are giving particular importance to this interaction between users and TV broadcasts. To realize how far the social conversation about international events goes, you could take a look at Twitter’s recap on FIFA World Cup 2014 group stage.

cristianoDuring the conference we could see the ways industry and researchers are taking to make their point on Social and Interactive TV. For example, second screen applications allow viewers to have a deeper understanding on what they are watching, providing additional information related to the broadcast (usually ad hoc and synchronized for a better user experience) or through automatic trends discovery. Other approaches try to help users finding the right TV programs by studying their habits and behaviors when watching television.

For our demo, we chose to visualize two World Cup matches being played at the same time: United States – Germany and Portugal – Ghana.

Continue reading