Cultivating a state of mind where new ideas are born (2023)

The "new ideas are fragile" is certainly true. I'm struggling with something I'm building which I think is extremely cool but technically difficult, but which if based on the reaction of friends and family I'd abandoned long ago. Only after having worked on it for 2 years and really got it working technically did I see a small spark in my dad's eyes as he said "oh, you can make MONEY off of this?". I feel like I have a strong internal compass but I have to admit external validation is needed at some point, but I noticed some people I just cannot share ideas with. They're in the habit of shooting down anything, and they would have found 100 reasons that any famous company or product would have failed. Unsurprisingly these people have not achieved much themselves, never taking any risk.

Just read the beginning but I feel like there are obvious counter examples. Basically lots of academic environments. I personally (and somewhat sadly) did my best work in grad school, thanks entirely to the environment. All of us in the lab I studied in benefitted from being around each other every day. From what I’ve seen, this is very common throughout history in academia.

Maybe it’s pressure that kills ideas, or competition, or premature desire to commercialize, or just the kind of people that become founders; it’s definitely not co-working in and of itself.

Should add I agree that solitary reflection is important, just not that being surrounded by like minded people is detrimental.

There are a few mathematicians that have analyzed and wrote about their process. A recent (IMO) good writing on the subject is David Bessis' "Mathematica" (I found this review https://siliconreckoner.substack.com/p/review-of-mathematica... which I haven't had a chance to fully read). It covers both a personal perspective as well as examples from Grothendieck, Descartes and others.

Having had the opportunity to have ideas and pursue them extensively as a corporate employee, startup founder, and independent researchers, all I can say is that there seems to be a violent agreement of how stuff actually happens and that it's almost never fully made possible in either industry or academia. It's like a living irony.

For a deeper treatment of the broader subject - one of the most cited books is the "The Structure of Scientific Revolutions"

> what they are referring to as solitude is rather something like “a state of mind.” They are putting themselves in a state where the opinions of others do not bother them and where they reach a heightened sensitivity for the larval ideas and vague questions that arise within them.

Reminds me of that Rick Rubin quote:

The confidence that I have in my taste and my ability to express what I feel has proven helpful for artists.

Owl in owl's way I in mine Can't get to sleep

Wind from the sea Butterflies in embankment weeds Never resting (1915) Taneda Santoka

I think solitude is great. The hard part is finding the right people to talk to. I'm not sure if this is a Silicon Valley thing, but I've met some people who use a lot of jargon in a way that feels partly about status. At first I thought they just had a lot of ideas. Then they started talking about things in my own field, and I realized they were getting some pretty basic concepts wrong.

My guess is that some of this comes from listening to too many podcasts. You can pick up a lot of jargon and big ideas pretty quickly, and some podcasts are better at giving you that "oh, now I get it" feeling than actually helping you understand the ideas.

I’m going to sound rude here but I think the debate around solitudal achievements suffers a great deal from bias. For one, survivor bias favours the ideas emerging from deep thinking work. We overestimate however how much of that is the deep thinking vs quantity tradeoff. Einstein had many, many, many ideas and the majority of them were pretty bad if not outright outrageous. If you have the time and environment to produce a million ideas and pursue them, your likelihood of a good idea goes up. A second issue is that ideas almost never come up in isolation. The countless women behind the men erased from history tell exactly this story. Nowadays we fight the same fights about attribution. I should write a detailed account on why the arguments named in the article are not supported by evidence from cognitive research, but I for one am convinced a conductive environment is 1000% the ingredient necessary to come up with revolutionary work, rather than some magical great man thinking fantasy.

Probably not enough data on this yet since it's a new unlock, but I think it's perfectly possible to do great work today without interfacing with other humans directly. Some weird off-spectrum people (the kind this article is talking about) might even prefer to or work better this way.

Why is there always a self-imposed need to extract something from ourselves instead of just being? I really hate this in the modern world. Maybe one of the worst defining traits of industrial times.

I feel like this is relevant to the takes of "ai psychosis". I spent about 600 hours working alone with AI before I was ready to collaborate, re-discovering things in my own process that others may have already known sprinkled throughout twitter and youtube, etc. and really being open to the wonder of it all.

This is so true. I've had some inventive ideas during certain phases of being a hobbyist and very small business owner. Sometimes I'd share them prematurely. Just killed the momentum, and I'd look back and say, "what happened?"

Ever hear the very early Talking Heads song, "Artists Only" - David Byrne remarks,

"pretty soon now, I will be bitter, pretty soon now, I will be a quitter. You... can't... see... it... til it's finished"

My father knew this too, intuitively. He did some really nice, not-for-profit, practical projects on a very low budget. He'd like to comment during those fruitful years, "now, that's a pregnant idea" - the point being, perhaps, that you want to allow the idea to develop way past the fertilization stage, before releasing it into the world. The British have a term, "half-baked idea" that may run along the same lines.

What a nice essay. Thank you, author! It's hard to imagine these insights being hatched by interactions on social media, where everyone is a critic, and always so cock-sure that their biases are so correct.

Of course, our educational system is loaded the the dialectic-style interaction style, where there is a dogma that the truth can be arrived at by negation of opinions through a Socratic question-and-answer dialogue, but that often often goes nowhere. In my most productive R&D experiences, where I was often the only guy in the lab who had various consultants milking the billable hours, the best bosses would give plenty of space for diving into trying this or that, because they respected that intuition needs to run free. Then, the numbers and other results would validate the assumptions or instincts. But just point-blank instinctively shooting down every new idea... often goes nowhere - and happens so often. Too often.

Thanks again.

Under certain conditions you may get more good ideas than others.

This can be cultivated and if you end up with one or more ideas in excess of what you can possibly deploy, that would be a surplus.

Under ideal conditions that is.

So it stands to reason that ideally the same place that good ideas come from, is the exact same place where more of them die than anything else :\

FYI the so-called Bertrand Russell quotation is apparently in fact an expanded paraphrase of Carl Sagan, The Burden of Skepticism (1987):

Britain has produced a range of remarkably gifted multidisciplinary scientists and scholars who are sometimes described as polymaths. The group included, in recent times, Bertrand Russell, A. N. Whitehead, J. B. S. Haldane, J. D. Bernal, and Jacob Bronowski. Russell commented that the development of such gifted individuals required a childhood period in which there was little or no pressure for conformity, a time in which the child could develop and pursue his or her own interests no matter how unusual or bizarre.

Still earlier Sagan The Dragons of Eden: Speculations on the Evolution of Human Intelligence (1977), Chapter 8, 'The Future Evolution of the Brain'.

It's called a shower.

[flagged]