You are not missing the point and bring up something my jaded views keep reminding me about. It is important to not believe too much in your efforts so as to stay grounded and not be too enthusiastic and get disappointed when downturns inevitably appear.
I'm battling between two approaches about data collection: the tedious manual entry on behalf of devs or the fully automated scrapping a la other existing efforts in the field