Forum Overview :: We Love Katamari :: Stack Overflow is also shutting down their data sharing program

[quote name="blackwater"]<a href="https://meta.stackexchange.com/questions/389922/june-2023-data-dump-is-missing/390023#390023">The free lunch is over</a> [quote] DISCLAIMER: I was recently impacted by the Company's layoff. I am going to carefully respond in a way that ensures I don't reveal anything the Company may feel is confidential--particularly with regard to strategy, or future plans. Any knowledge I have on strategy or future plans is both dated and confidential, and thus it would be irresponsible for me to say more. As a result, this answer may feel incomplete. I suspect that the CM team is rather busy this week with other topics. I'm offering what I can to uphold the Company's values of Transparency & being Community-centric. <b>The upload to the Internet Archive has been disabled.</b> The job that uploads the data dump to Archive.org was disabled on 28 March, and marked to not be re-enabled without approval of senior leadership. Had it run as scheduled, it would have completed on the first Monday after the first Sunday in June. I mention the timing, as this change long pre-dated the current moderator strike and related policy changes. Some comments have suggested otherwise, so I thought it an important detail. <b>Is it going to stay that way?</b> Hopefully the Company will provide an answer that includes this. Edit: The following is an excerpt from a different answer provided by Jody Bailey, CTO of Stack Overflow: [quote] We are looking for ways to gate access to the Dump, APIs, and SEDE, that will allow individuals access to the data while preventing misuse by organizations looking to profit from the work of our community. We are working to design and implement appropriate safeguards and still sorting out the details and timelines. We will provide regular updates on our progress to this group. [/quote] <b>How can I access that data?</b> Stack Exchange Data Explorer (aka SEDE) contains a subset of all data for all sites, with PII removed. The same data available in the data dump is also available on SEDE. SEDE is updated via a weekly full refresh (every weekend). The Data Dump that is uploaded to Archive.org is a dump of the SEDE databases. The weekly SEDE refresh runs, then the data is dumped to XML & 7zipped, then the 7z files are uploaded to the Archive. SEDE can't address all the use cases of the Data Dump, nor vice versa. However, there is overlap, and the data is at least queryable. [/quote][/quote]