Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • The AI keeps mentioning how a HTTP 200 can silently pollute your dataset. Why not just check contents of body? Usually APIs follow strict JSON contract for successful queries, alert or throw an error when that changes.
  • >Is it legal? It is against TikTok's terms of service. It is sold for research and educational use.

    Oh, ok. Otherwise, very detailed deconstruction to scrape their API. Lots of layers of registration and creating a request that looks like it is valid client.

  • There's no way this dataset is going to survive on HF, right? It will be hit with so many DMCA takedowns.
  • 1787990085 | X and Meta's past data scraping lawsuit losses and how it would relate to nitter | https://www.reuters.com/legal/musks-x-corp-loses-lawsuit-aga... | https://news.ycombinator.com/item?id=49487864

    Perhaps Google can succeed where others like Meta and X have failed, or perhaps not

    https://storage.courtlistener.com/recap/gov.uscourts.cand.46...

  • > Everything described here is a private Go repository. One-time payment, permanent access, complete source. > $699 one time · lifetime access

    Not open-source apparently.

    And I cant find the reddit post but I think I read that videos/assets are not actually pre-downloaded, they have to be requested through Tiktok API using the provided code. So if Tiktok patches, the code will need updates too.

  • Can any brave soul wade through the LLM prose to provide a human-readable summary?
  • > Three things to notice, because each one bites later:

    Very LLMish language!

Explore Birbla archives

4.5B Posts Scraped from TikTok · Birbla