zlacker

[parent] [thread] 29 comments
1. klabb3+(OP)[view] [source] 2023-03-18 10:45:09
Content based auto moderation has been shitty since it’s inception. I don’t like that GPT will cause the biggest flood of shit mankind has ever seen, but I am happy that it will kill these flawed ideas about policing.

The obvious problem is we don’t have any great alternatives. We have captcha, and we can look at behavior and source data (IP), and of course everyone’s favorite fingerprinting. To make matters worse: abuse, spam and fraud prevention lives in the same security-by-obscurity paradigm that cyber security lived in for decades before “we” collectively gave up on it, and decided that openness is better. People would laugh at you to suggest abuse tech should be open (“you’d just help the spammers”).

I tried to find whether academia has taken a stab at these problems but came up pretty much empty handed. Hopefully I’m just bad at searching. I truly don’t get why people aren’t looking at these issues seriously and systematically.

In the medium term, I’m worried that we’ll not address the systemic threats, and continue to throw ID checks, heuristics and ML at the wall, enjoying the short lived successes when some classifier works for a month before it’s defeated. The reason this is concerning is that we will be neck deep in crap (think SEO blogspam and recipe sites but for everything) which will be disorienting for long enough to erode a lot of trust that we could really use right now.

replies(3): >>lifeis+x4 >>Andrew+26 >>coldte+q6
2. lifeis+x4[view] [source] 2023-03-18 11:35:40
>>klabb3+(OP)
I am unclear why a reasonable digital ID (probably government ID card style) plus rate limits is not going to be effective.

I can see lots of reaosns people might oppose the idea but I am not sure why it's not a widely discussed option?

(asking honestly and openly - please don't shout!)

replies(5): >>creaki+35 >>nprate+55 >>ipaddr+0e >>tbrown+ng >>wpietr+SD
◧◩
3. creaki+35[view] [source] [discussion] 2023-03-18 11:41:47
>>lifeis+x4
Closest example I know of is Korean internet. It is almost nigh impossible to get an account in major websites without SSN and a phone number. Despite this, there are still countless bots and scammers that uses hacked or leaked personal data. So I’m not sure if it would be that effective
replies(1): >>lifeis+u8
◧◩
4. nprate+55[view] [source] [discussion] 2023-03-18 11:42:08
>>lifeis+x4
Because the only way it'd work is if it was mandatory (because of point 2); it'd then be extended to porn sites to protect the children. That means politicians browsing history on pornhub would also be recorded and inevitably leaked when they get hacked.
5. Andrew+26[view] [source] 2023-03-18 11:52:21
>>klabb3+(OP)
> The obvious problem is we don’t have any great alternatives.

Of course we do. The rise of digital finance services has led to creation of a number of servives that offer identity verification necessary for KYC. All such services offer APIs, so adding an identity verification requirement to your forum is trivial.

Of course, if it isn't obvious, I'm only half joking.

6. coldte+q6[view] [source] 2023-03-18 11:55:20
>>klabb3+(OP)
>The obvious problem is we don’t have any great alternatives.

There's always identity based network of trust. Several other members vouch for new people to be included.

replies(3): >>eterna+m9 >>groest+Ba >>wpietr+WB
◧◩◪
7. lifeis+u8[view] [source] [discussion] 2023-03-18 12:14:27
>>creaki+35
I am thinking more like webauthn - but where I own a key pair, and I go to post office with my passport, they give me a nonce and prove that my it's my key pair then they post that public key is definitely me. I then can use that posting as my "username" and any challenge response includes the public key so they know that only I could be signing up

I am very aware of "designing a security system they themselves cannot break" and the difficulties of key management etc.

Would be interested in knowing more from smarter people

(probably need to build a poc - one day :-( )

replies(1): >>bombol+Xl
◧◩
8. eterna+m9[view] [source] [discussion] 2023-03-18 12:22:10
>>coldte+q6
Maybe even push that a level higher and have org to org vouching as well (so it can scale and reputation propagates social bubbles.) Bootstrapping remains somewhat an issue.
replies(1): >>wongar+Ac
◧◩
9. groest+Ba[view] [source] [discussion] 2023-03-18 12:34:41
>>coldte+q6
I've mentioned a "market of lemons" elsewhere in this thread. One such market is the market for malware and stolen credit card details. One result of the market being broken: serious criminals restrict themselves to very small (company like) social circles and invite only forums. One signal of trust that remained very long: a very short ICQ number. You don't want to burn such a handle with a bad trade, so trust was given upfront.
◧◩◪
10. wongar+Ac[view] [source] [discussion] 2023-03-18 12:53:27
>>eterna+m9
One somewhat popular solution for bootstrapping is to allow people to buy in, paired with quickly banning those members in cases of rule violation. It's by no means perfect, but it puts a real price on abuse and thus reduces it a lot
◧◩
11. ipaddr+0e[view] [source] [discussion] 2023-03-18 13:06:55
>>lifeis+x4
If spam was your only problem now we have two spam and identity theft. Selling/obtaining identity information becomes very profitable and those working in the postal office must guard access like a bank vault.
replies(2): >>lifeis+gn >>wpietr+EE
◧◩
12. tbrown+ng[view] [source] [discussion] 2023-03-18 13:23:46
>>lifeis+x4
Anonymity is critical to free speech, because there exist bad actors who will resort to violence to suppress speech they don't like.
replies(1): >>lifeis+Cm
◧◩◪◨
13. bombol+Xl[view] [source] [discussion] 2023-03-18 14:11:37
>>lifeis+u8
> I own a key pair

Right there… it won't work with the general population.

replies(1): >>lifeis+Pm
◧◩◪
14. lifeis+Cm[view] [source] [discussion] 2023-03-18 14:15:54
>>tbrown+ng
But, and I understand the argument, that is a problem for IRL society / government to solve.

If someone walks upto me in the voting booth and says "vote for X or I will kill you" that's a crime. If they do it in the pub it's probably a crime. If they do it online the police don't have enough manpower to deal with the situation.

We should change that.

Every time some fuckwit tweets "you and your kids are going to get raped to death and I know where you live" because some woman dares suggest some political chnage I would like to see jail time.

And if we do that then I can understand your argument, but I would then say it is not valid - in a society that protects free speech.

replies(3): >>woile+6o >>tbrown+qx >>__Matr+Kx
◧◩◪◨⬒
15. lifeis+Pm[view] [source] [discussion] 2023-03-18 14:17:50
>>bombol+Xl
something like 2 billion people have a phone with a secure enclave capable of this in their pockets today - and they use it everyday for logins, payment and paying at the car park.

We have the penetration

(Afaik smartphone penetration is around 4.5-5 BN, and something like 50%+ have secure enclaves but honestly Indont follow that deeply so would defer to more knowledgeable people)

replies(2): >>klabb3+mD >>bombol+Dn2
◧◩◪
16. lifeis+gn[view] [source] [discussion] 2023-03-18 14:21:55
>>ipaddr+0e
Then make it a banks job to guard the bank vaults - they need to earn that FDIC bailout money :-)
◧◩◪◨
17. woile+6o[view] [source] [discussion] 2023-03-18 14:28:34
>>lifeis+Cm
Actually, there could be places where verified humans are required, and places where they are not.
◧◩◪◨
18. tbrown+qx[view] [source] [discussion] 2023-03-18 15:41:06
>>lifeis+Cm
That doesn't work so well when the government is one of the bad actors.
replies(1): >>lifeis+8E
◧◩◪◨
19. __Matr+Kx[view] [source] [discussion] 2023-03-18 15:43:12
>>lifeis+Cm
I'm far less worried about being intimidated into voting a certain way by someone who is avoiding the authorities online.

Much more likely is that I'll vote ignorantly because I lack information that someone withheld because they're intimidated by the authorities.

◧◩
20. wpietr+WB[view] [source] [discussion] 2023-03-18 16:12:43
>>coldte+q6
How would you imagine that applying here? If fake accounts are at least as convincing as real ones, then it seems like trust networks would be quickly prone to corruption as the fake accounts gain enough of a foothold to start recommending each other.
replies(1): >>coldte+Ft1
◧◩◪◨⬒⬓
21. klabb3+mD[view] [source] [discussion] 2023-03-18 16:20:51
>>lifeis+Pm
That’s not your identity, it’s an access token protected by an advanced lock screen (which is greatly useful, but not the same). If you lose your device, the way you get back into your accounts is your de-facto identity—usually it ranges between the email you used during signup to your govt id.

There isn’t a widely deployed public key network with keys that represent a person, afaik. PGP is the closest maybe?

◧◩
22. wpietr+SD[view] [source] [discussion] 2023-03-18 16:23:57
>>lifeis+x4
I expect that's where we're heading. But then, as somebody who writes online mostly under my own name, maybe I'm just biased. Come on in, the water's fine!

I think there are cases for anonymous/pseudonymous speech, but I think that's going to have to shift away from disposable identities. Newspapers, for example, have been providing selective anonymity for hundreds of years, so I think there's a model to follow: trusted people/organizations who validate the quality of a non-public identity.

So a place like HN, for example, could promise that each pseudonymous account is connected to a unique human via some sort of government ID with challenge/response capability. Or you could end up with third-party ID providers that provide a similar service that goes beyond mere identity, like the Twitter Verified program scaled up.

Disposable identities have always been a struggle. E.g., look at Reddit's very popular Am I the Asshole, where people widely believe a lot of the content is creative writing exercises. But keeping up a fake identity over the long term was a lot of work. Not anymore, though!

◧◩◪◨⬒
23. lifeis+8E[view] [source] [discussion] 2023-03-18 16:25:41
>>tbrown+qx
My point is that if government is a bad actor, there is no recourse. We need a fair democratic society - it's on us to build one / keep it there
replies(1): >>accoun+L06
◧◩◪
24. wpietr+EE[view] [source] [discussion] 2023-03-18 16:29:01
>>ipaddr+0e
The paradigm of fixed identity information as proof is pretty obviously doomed. Just like how the 1970s concept of username/password as proof of identity is on its way out. Or credit card numbers alone being used to validate transactions.

All of those notions are pre-internet ways of proving identity. In a world where we're all rarely more than an arm's length from a globally connected computer, they're on the way out.

replies(1): >>lifeis+6F2
◧◩◪
25. coldte+Ft1[view] [source] [discussion] 2023-03-18 22:09:12
>>wpietr+WB
On a network started by 2-3-10 people, the first new members would need to be vouched by a percentage of those to get in - and so on.

If someone down the line does some BS activity, the accounts that vouched for it have their reputation on the line.

A whole tree of the person who did the BS and 1-2 layers of vouching above gets put on check, gets big red warning label in their UI presence (e.g. under their avatar/name), and loses privileges. It could even just get immediately deleted.

And since I said "identity based", you would need to provide to real world id to get in, on top of others vouching for you. It can be made so you wouldn't be able to get a fake account any easier than you can get a fake passport.

replies(1): >>wpietr+f54
◧◩◪◨⬒⬓
26. bombol+Dn2[view] [source] [discussion] 2023-03-19 08:23:20
>>lifeis+Pm
> something like 2 billion people have a phone with a secure enclave capable of this in their pockets today - and they use it everyday for logins, payment and paying at the car park.

They don't own a key pair. They carry one around, which is owned by google or some other entity?

◧◩◪◨
27. lifeis+6F2[view] [source] [discussion] 2023-03-19 12:02:42
>>wpietr+EE
I am guessing that "fixed identity information" is not a key pair ?
◧◩◪◨
28. wpietr+f54[view] [source] [discussion] 2023-03-19 21:04:43
>>coldte+Ft1
Are you talking about in-person verification and vouching? Or can it be digitally mediated?

If the former, it looks quite impractical unless there are widely trusted bulk verifiers. E.g., state DMVs.

If the latter, then it all looks quite prone to corruption once bots become as convincing correspondents as the median person.

replies(1): >>coldte+bc4
◧◩◪◨⬒
29. coldte+bc4[view] [source] [discussion] 2023-03-19 21:50:21
>>wpietr+f54
>Are you talking about in-person verification and vouching? Or can it be digitally mediated?

Yes and yes.

>If the former, it looks quite impractical unless there are widely trusted bulk verifiers. E.g., state DMVs.

It's happened already in some cases, e.g.: https://en.wikipedia.org/wiki/Real-name_system

>If the latter, then it all looks quite prone to corruption once bots become as convincing correspondents as the median person

How about a requirement to personally know the other person in what hackers in the past called "meatspace"?

Just brainstorming here, but for a cohesive forum, even of tens of thousands of people, it shouldn't be that difficult to achieve.

For something Facebook / Tweeter scale it would take "bulk verifiers" that are trusted, and where you need to register in person.

◧◩◪◨⬒⬓
30. accoun+L06[view] [source] [discussion] 2023-03-20 13:15:37
>>lifeis+8E
It might get to be that way some day, but for now there is recourse. France is (in)famous for it and they are currently making use of that way.

And this is important because a "fair democratic society" that doesn't need people to be able to protest is, as history has shown many times, only a temporary affair. The best way to keep it is to not give the government the tools a worse government could use to suppress dissent.

[go to top]