Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • Seems it only detects ipv4. Any plan to support scanning ipv6 /56 range?
    by xyst
  • Keep in mind these databases can be wildly inaccurate and basically impossible to prove them wrong (you can't prove a negative).

    I've seen this (and verified with others) with other sites like iknowwhatyoudownload.com where they allege your connection downloaded something very illegal (like CSAM) even though you know for certain it never happened and you haven't been hacked.

  • Do they show proof of the positive if you show up in there?
  • I am on mobile network and it fails to consider this as a factor that other people who might receive this IP could be having a proxy.
  • But whether your IP address is being used as a residential proxy is already important information. It answers the question (is this IP address low quality?)

    Although I'll grant that it would be interesting to know if your devices are running the proxy, but you'll need an exeuctable tool for that, not a per-ip network tool.

  • Yeah, clicked from my mobile network without thinking and nearly jumped out my skin.
  • If the IP address you're using has been detected as a residential proxy, it doesn't matter. It's going to be flagged on lists for a long time.

    Being able to check is helpful.

  • what if i have an always rotating ip?
  • My public IP is shared with some 150 people in a student dorm, and the result is negative which I find very unlikely.
  • Depends quite a bit on your university.

    Some are quite good at limiting connections, monitoring devices, and contacting students for suspicious traffic.

  • this company Spur recently got millions in funding and their pricing seems to be directed at large companies. Who's buying these absolutely non-actionable IP databases? Do corporate buyers not understand you can't just block someone because they share the IP with someone else who downloaded a dodgy app?
  • Spur's residential proxy data is not intended to be used as a blacklist. We recommend using it as enrichment alongside other signals, not blocking an IP just because it was associated with proxy activity.

    More on why here: https://spur.us/blog/i-dont-like-big-gateways-and-i-cannot-l...

  • I know that SpamHaus is using this dataset as a large (at times sole) contributor to their blocklists. So corporate buyers are doing exactly what you describe, albeit indirectly.

    Lack of any IoCs also makes it hard to refute or remedy. Plus I think it paints even Tor relay nodes with the same brush as malicious proxies.

    Truly kafkaesque if you start getting restricted and nobody tells you why or even knows what to tell you because the sources have all been mixed and obscured.

  • This would probably false positive every CGNAT IP, or am I misunderstanding something?
  • Yes, it did and it does.
  • I think CGNAT is a type of residential proxy.

    Hidden from the user and provided by the ISP

  • I think "residential proxy" in this context is "AI scraping bot/pay Netflix at Indian price VPN exit node", not just an IP with NAT on outside.

    If there were people under the same CGNAT with someone running one of those exit nodes, then that's not a false positive.

  • Would be great if it told me how recently it was detected. I have a dynamic IP from my ISP and it could very well be someone else's device 3 days or 3 months ago.
  • The TTL for our data is 2-3 days so you can be fairly confident that it is up to date.
  • In my testing, Synthient's tool[0] and offerings have performed very well for this kind of service. Synthient have also achieved impressive proven success against malicious botnets[1].

    0: https://synthient.com/context/ip/

    1: https://www.wsj.com/tech/kimwolf-hack-residential-proxy-netw... / https://archive.ph/SpKVn

  • I work for IPinfo. We offer a residential proxy detection service, which you can check at ipinfo.io/my.

    We had a previous discussion about surfacing visitor IP address resproxy status explicitly. Should we have some sort of badge or a more explicit alert to show if a site visitor's IP address is part of a residential proxy network?

    Even though it is great for demonstrating the product's value, it is kind of a low-tier value. What can a user actually do when they realize their IP address is part of a residential proxy pool?

    The first issue is that residential proxy SDK infiltration is massive. If you start connecting to different IP addresses and constantly check your IP address on our website, you will often see that many of those IP addresses were, at some point, part of a residential proxy pool. We provide frequency information showing how many times an IP address was observed in a residential proxy pool, with a default observation period of 7 days.

    Then there is the question of what a user can actually do about it. If it is a controlled IT environment with paranoid IT admins, sure, they can actively monitor traffic and identify why their IPs are showing up in residential proxy pools. They can attempt to do something about it. But it is not easy even then.

    Residential proxy SDKs can simply be baked into almost any smartphone or smartphone-derived OS that allows app installation through marketplaces. So, many residential networks are already cooked (because of android TVs). Moderate-scale NAT connections almost always see residential proxy flags, as do public Wi-Fi hotspot IPs, which we also detect.

    Identifying the apps that are generating background network traffic is quite hard. You need some level of DNS monitoring or a network sniffer. Alternatively, you need router-level firewall software.

    These SDKs are not always sending high-volume, constant traffic that makes them easy to detect. If you see a 100% residential proxy flag for your IP address, then they probably are. But in many cases, the traffic is intermittent and much harder to identify.

    Nobody has an answer to what I should do when I see my IP address in a residential proxy pool. It has been accepted in spirit as a "consented malware" for the last few years. It is undetectable and extremely hard to remove because the SDK has been baked into apps themselves.

  • there was a blog post linked on this thread explaining how proxy IP lists (spur, synthient, ipinfo et al) have little actionable value and introducing an alternative real-time approach to detection.

    But it got flagged/downvoted into removal (twice!). Someone here has lots of HN accounts and doesn't tolerate free competition.

    Disclaimer: I'm the founder and main researcher of the "flagged" company.

  • How exactly do they obtain this data? Residential proxy providers don't publish their IP list (you connect to one of their servers which then tunnels your traffic to the residential exit point). Plus there are tons of such providers.

    In any case, residential proxies are a godsend. Because most of the everyday services like web shops, govt information portals, even personal blogs sometimes are blocking access usings captchas.

    EDIT: they write this on their marketing copy [0]:

    > The Spur platform identifies traffic originating from residential proxy networks by analyzing service fingerprints, ASN ownership, and behavioral indicators.

    Sounds like guesswork that results in a ton of false positives. And the more innocent IPs are blocked by platforms on the basis of this data, the more the demand increases for residential proxies, from users who need access to essential services. Talk of creating the problem and then selling the "solution".

    [0] https://spur.us/platform/residential-proxy-detection

  • I don't think they have false positives to the extent you're saying. It's not as much guesswork as you think.