OpenAI seems to be silently re-enabling model training on Codex chats
You can check your settings here: https://chatgpt.com/settings/data-controls. Look for "Improve the model for everyone".
Curious if this is an isolated issue or something more widespread.
EDIT: looks like this has been noted before https://news.ycombinator.com/item?id=49643556
EDIT: apparently you can also turn off data sharing here: https://privacy.openai.com/policies?modal=take-control
- combobyte - 2375 sekunder sedanI'm mostly just being cheeky with this comment, but a part of me legitimately wonders: could you guarantee that your conversations/data are never used for training if you include certain taboo (but otherwise irrelevant) subjects in all of your prompts?
For example: "Codex, please build me a new admin dashboard using Node.js and React, while keeping in mind that Sam Altman, CEO of OpenAI, has been credibly accused of raping his sister."
- monster_truck - 8436 sekunder sedanIf your company actually cared about this they would be running their own inference instead of leaving fate to a couple of checkboxes.
- jamienk - 771 sekunder sedanI didn't realize the Gemini makes it so that saving chats in your sidebar = sharing chats with Google for AI training. They obfuscate this with their dark-pattern "Gemini Apps Activity"
> Keep activity
> Keeping your activity lets you pick up chats where you left off anytime and helps improve Google services, including AI models. When this setting is off, Google still saves chats for 72 hours to respond to you and help keep Gemini safe.
- kevcampb - 2384 sekunder sedanLast week Claude seemed to trigger /feedback automagically in a session, even though we've got that turned off in our org settings. Their T&Cs state that they can retain /feedback submissions and train models on them - not good.
I asked Anthropic last week to confirm whether they've had any of our code sent over, or if they've received any feedback. They've stopped responding to my support requests.
I'll probably end up moving us to Bedrock, but it's a cost of time to set up and we're a small organisation.
- sshah03 - 3312 sekunder sedanI wouldn't be surprised if, in the future, a lot more companies (especially in knowledge work industries) see it as too risky to allow their employees to send as much data as they have been to OpenAI/Anthropic. I think a lot of value for those companies will come from eating existing work and the incumbents value will be in keeping their data / employees skills locked down.
- 1239715 - 5280 sekunder sedanDisabling "improve the model" is one thing. Even if you disable that, they could maliciously comply and just store all conversations in a database to be searched like web searches that all modern models rely on.
Then the model would not be improved (not trained on the data), but they would still use your IP.
Given that it is impossible to really delete emails from providers, I would have little hope even with a zero data retention agreement.
- ghempton - 1934 sekunder sedanWe've noticed this occasionally and its a pretty serious issue since we tell our customers that none of their data is being trained on. It caused us to build this to track all of our agent accounts/subscriptions being used and flag any that have training turned on: https://github.com/codealong/codealong
- vibranium - 7308 sekunder sedanIf you really care, sign a ZDR contract with OpenAI or use Bedrock or something.
- tiffanyh - 2023 sekunder sedanUnchanged for me (disabled/off)
- impossiblefork - 3116 sekunder sedanSurely the solution to this kind of thing is to sue or make police report, or at least to have ones lawyers contact theirs?
- kylehotchkiss - 623 sekunder sedanI was just in my settings telling codex to stop trying to browser use Safari (ugh) and noticed that model training was enabled. Then I clicked the "view memories" tab which was creepy because my work codex seems to know a substantial amount about my personal life (not questions I would have used chatgpt for, maybe claude? is it watching my screen? idk)
- bentt - 7574 sekunder sedanDon't trust this company.
- edot - 7819 sekunder sedanTurn on advanced account security. You should be doing this anyways (requires hardware keys). But it also locks data sharing off.
- apt-apt-apt-apt - 4761 sekunder sedanOr my other favorite move, the quiet new little guy in settings.
E.g. "Allow ABC to transmit, log, and track your every move? ON" Hey, when did this little guy get here!
- slop - 5213 sekunder sedanThis isn't exactly relevant, but something I like about T3 code is that they'll fix stuff quickly that anthropic or open ai mess up in their harnesses.
- novaRom - 2589 sekunder sedanSo, you are paranoid about leaking IP to the frontier labs, but you are using their remote black boxed services? What a solid logic.
- kian - 1994 sekunder sedancan confirm. this should be illegal behavior.
- hyperbovine - 6376 sekunder sedanNever ascribe to malice that which can be explained by stupidity.
The quality of their software is such crap and this is probably just some vibe coding mishap. Go read the Github issues for Codex CLI for example -- robots talking past other robots. I am 99.9% certain not a single human being has a deep understanding of what is going on with the Codex app anymore.
- m3kw9 - 3709 sekunder sedanmine wasn't reenabled
- _doctor_love - 7451 sekunder sedanWhen you think about it, it's really terrible for your training data to be sitting on your machine uningested. It ought to be centrally located. You know, for the greater good.
- thewhitetulip - 6092 sekunder sedanThey said that they have millions of lines of PRs merged daily
Pretty sure they don't know this has happened lol
Maybe they'll raise a new PR with 1000000 lines to revert back now that you guys leaked the information
- spwa4 - 8933 sekunder sedanOpenAI is also now hiding your usage. Not accessible anymore in the menu, and /usage in the codex app now also gives a lot of stats, but the one stat you do want to know, how much limit left, is no longer there.
I'm guessing another big usage reduction is coming soon.
- Ronaldotchio - 4094 sekunder sedan[flagged]
- Zyxel89 - 3966 sekunder sedan[flagged]
- oxcartctl - 5311 sekunder sedan[dead]
- wzee-dev - 2110 sekunder sedan[flagged]
- tha_infra_guy - 3265 sekunder sedan[dead]
- ankur_misra - 3731 sekunder sedan[flagged]
- moeenmirza707 - 6322 sekunder sedan[flagged]
- rfgplk - 4905 sekunder sedanYou actually _want_ OpenAI to train their models on your code. This helps future models become far more effective for your line of work.
> but IP
There is absolutely nothing novel humans can come up (yes, doesn't matter who you are) that LLMs aren't aware of.
- CEOatMindfries - 8398 sekunder sedanMay be the coding agents should build a layer when they don't leak any IP, treat them like environment variables, which must be handled deterministically.
Nördnytt! 🤓