Was what the mathematician Ed Witten did to receive the Fields medal legitimate mathematics, or not?
“Physicists on Quora and in the physics community claim that Witten does not follow mathematical rules in his creation of string theory. So was his mathematics for the fields medal legitimate or is it possibly nonsense?” (From the question’s details.)
The Fields Medal
Let me tell you something about the Fields medal.
Apart from the fact that it is the most prestigious award in the mathematical world (so you may safely assume it does not get awarded to anyone for any kind of “arbitrary nonsense”), there's another aspect of the medal that's somewhat less well known.
The Fields medal is only awarded to people under 40. This is why Andrew Wiles, who sensationally proved Fermat’s Last Theorem, wasn't awarded one. So weren't many other incredible mathematicians who missed the deadline, so to speak.
The reason this age limit is in place is because the medal was meant to encourage young researchers. It was not designed as a “lifetime achievement” medal, like the Nobel Prize, but as a way to support or motivate promising mathematicians so they keep on researching and producing revolutionary ideas.
Not entirely surprisingly, this ideal doesn't always play out. Creating truly novel, groundbreaking theories isn't something many people can do once in a lifetime, let alone twice. Since the Fields medal is so prestigious, and is awarded to so few people, it is naturally awarded to mathematicians who have already produced the finest of the finest in original research, and it's almost unreasonable to expect them to continue to be as sensationally creative.
Indeed, for a good number of past medalists, nothing they did after the medal comes close to the body of work that won them the Fields. To be clear, this isn't any kind of criticism or a downplaying of their ingenuity: every single Fields medalist did something incredible. It's just that the “young, promising researcher” thing is setting the bar quite unreasonably high.
There are, however, exceptions. A number of awardees were such profoundly transformative mathematicians that they achieved no less after the medal than before it – so much so that they perhaps would have been awarded a Fields for their latter work alone.
I'm far from qualified to judge who, exactly, deserves to be on the shortlist of the shortlist, the elite of the peak of human mathematical achievement. Grothendieck is certainly among them. So is Serre, and Atle Selberg who developed the profound Trace Formula that bears his name six years after receiving the medal, and several others I would dare name.
And, in my mind, for whatever that's worth, so is Witten.
Witten’s Work
Ed Witten was awarded the Fields medal for a series of groundbreaking mathematical discoveries which, in the words of Sir Michael Atiyah, have “made a profound impact on contemporary mathematics.” Through Witten’s work, Atiyah continued, “physics is once again providing a rich source of inspiration and insight in mathematics.”
Witten was awarded the medal in 1990, when he was 39 years old (as you can imagine, it's quite uncommon for people to land it long before the age 40 limit). By then he created topological quantum field theory and discovered deep links between Morse theory and supersymmetry.
Let's be clear: those are mathematical achievements. The IMU didn't just decide it was time to give some physicist a medal. The mathematical theory of knots and 3-manifolds, to give one example, is forever changed thanks to Witten’s pre-Fields work.
But he wasn't quite done yet.
The “second revolution” of string theory was sparked in 1995 by Witten’s amazing discovery that the various extant string theories are but shadows of a single idea now called an M-theory.
That's physics, so to speak. But in math, the Seiberg-Witten invariants had an impact on the theory of 4-manifolds that's at least as profound as his earlier work on 3-manifolds, and I've seen mathematicians refer to them as Witten’s finest achievement. This is 1994, four years after the mathematical world already deemed his work worthy of its highest honor.
Putting in question the legitimacy of Witten’s contributions to mathematics is a few notches beyond ridiculous. He stands out even among the best of the best of them, as one of the few who continued to work miracles even after they received the medal.
String Theory
The question refers to “string theory arbitrary nonsense”, so I feel obliged to say something about that as well.
String Theory isn't complete or perfect, and may never become either. It may eventually come to be understood as merely a step, or more likely a collection of important steps and some missteps that were still inevitable in our quest for a unified theory.
But branding it “nonsense” is just ignorant. Whatever it is – almost the whole truth, a glimpse of the truth, or a beautiful non-truth which miraculously manages to come ever so close to the truth – one thing it cannot be is nonsense. It's a magnificent, shining edifice of such internal cohesiveness and beauty that it almost doesn't matter if it doesn't describe our own universe: the universe it does describe deserves our attention and exploration.
Like many theories under formation, it has parts that are conjectural or speculative, but it also has huge sections that are worked out in complete rigor.
Like many present and future physical theories, it makes predictions that are difficult to confirm with available technology. That doesn't mean it's “not falsifiable” in principle. In fact, any new mathematical theory that produces the same results as QED or QCD is by definition falsifiable: it would have been falsified by any experiment that would refute QED or QCD. There's huge value in finding new mathematical frameworks that “merely” recast the current theories in a new setting. This isn't a retraction of Popper’s ideas about science; it's the observation that multiple distinct theories can produce the same observables and are therefore worthy of equal scrutiny.
It's been said that string theory already made one profound prediction: it predicts gravity. This is, of course, a joke, but it has a kernel of truth. A theory that reproduces the standard model of particle physics and yields gravity as a natural outcome does something very special that the current standard model doesn't do. It could be wrong, but it cannot be worthless.
Mathematical Rigor
Finally, I believe that there's enormous misconception around the “non-rigorous” aspects of Witten’s work (as well as others, such as Thurston's), and around the whole notion of mathematical discovery, conjecture and proof.
Intuitive ideas, half-formed theories, heuristic arguments, nonsensical transformations, provably false derivations, partial analogies, guesses, wishes, and vaguely describable dreams are a huge, crucial and inevitable part of mathematics. Missing this is misunderstanding mathematics and creativity.
Proofs don't emerge in a vacuum. Theorems don't fall like ripe apples on mathematicians’ heads out of some divine tree. Everything comes from imagination, and while we are imagining and fantasizing we are often deliberately and knowingly making non-rigorous statements. Doing mathematics any other way is like programming a MacBook to spit out true statements in ZFC. Rigorous and correct, but pointless.
Criticizing Witten’s work for being non-rigorous is making two profound errors. First, a tremendous amount of his work is completely rigorous. Second, the parts that aren't matter just as much. They point the way for others to fill the gaps and formalize the arguments. They create spaces for people to work in. They guide and innovate in original, imaginative ways.
Asking good questions and making good conjectures has the same amount of value to mathematical development, or more, as proving things. Anyone who told you otherwise misunderstands what it means to do mathematics and to be a mathematician.
This came out longer than I had expected, but honestly it's even less emotional than it would have been had I written it immediately when the question was asked. I feel strongly about these things, yes. And I hope I've answered your question.