A breakdown of SN13’s dashboard: historical data, mining activity, and enhancements for Gravity
Visualizing our decentralized data scraping activity.
Subnet 13 recently reached a significant milestone: it is currently the largest social media dataset in the world. Not only does this demonstrate success for Bittensor and Macrocosmos, but it also demonstrates what decentralized data-scraping can do.
It's also just received a big update. We have released our SN13 dashboard, visualizing key metrics for validators, miners and the general public. While collecting data is tremendously important, it is equally significant that it can be viewed and understood.
People can see what type of data is being collected, what the parameters are, and how much has been gathered. The statistics are updated in real-time, so you can see ongoing progress. Currently, X and Reddit are the primary sources, with miners setting their sights on particular subreddits, hashtags, and phrases. However, the dashboard displays spikes in popularity of one source over another, allowing users to track their trending usage.
By simplifying the process of analysing and evaluating information, the new dashboard improves decision-making for those who want to direct their data-scraping through Gravity. Insights like this are useful for understanding what is being prioritized by miners, and where they are searching for data.
Dashboard features
The SN13 dashboard contains several features and statistics. These include:
Dataset size details
The dashboard tells you the total number of datasets, the total rows, and the number of rows getting added per day.
Historical data on rows being added
You can see a graph of how many rows are getting added over time, and from which source. These are plotted on a graph with their corresponding months.
Trending parameters
You can see which parameters are getting added to the most. For instance, if the data from r/politics is getting significant attention from miners then it will show as a trending topic. You can even search for historical trends as well. Over time, this will reflect the desires of validators more via Gravity.
Miner leaderboard
At Macrocosmos, we’re focused on celebrating the successes of miners, both as a way of showcasing our best-performing participants, and to improve transparency. You can see the first, second, and third-place miners based on the quality of data they’ve added.
Empowering Gravity
The SN13 dashboard is useful in and of itself, but it also serves a more specific purpose. Gravity is the product that sits upon SN13, increasing its utility, and adding the ability to direct the follow of data-scraping towards those who are interested in specific topics. With this in mind, it makes more sense than ever to have a way to seeing which data already exists within our subnet. With Gravity’s implementation of dynamic desirability, visual representations of data become powerful tools for mapping validator interest. Validators can now grasp the current state of the data, so they can make more informed decisions on what they might want.
This is because Gravity adds new functionality to SN13, that allows validators to stake their weight to towards particular parameters that they want access to. By allowing validators to vote on the direction of data collection, it further democratizes our data-scraping and its directability. For example, if validators want data that is particularly focused on current political affairs, they could set their parameters around that, which would communicate to miners that they would be rewarded more for picking up data fitting this categorisation.
A greater view of decentralized data scraping
SN13’s dashboard will provide an intimate view of the types of data validators are interested in selecting via Gravity. This will likely reflect current affairs, indicating of where value lies within such large datasets. Plus, it places the shape of SN13 further in the hands of validators via enhanced democratic processes.
SN13 already exemplifies the power of distributed data scraping. By visualising this process, the dashboard makes it easier to understand at a glance. This new perspective promotes a more global overview of the subnet, which can drive more insightful decision-making.
That’s why we’ll continue to launch and enhance dashboards for all our subnets. They add dimension which magnifies context and supports improves functionality, usability, and ultimately, performance.