There’s much to profit from in Moran’s recent interview at 3am magazine. The section on Experimental Philosophy is a tour de force.
As to ‘experimental philosophy, I can’t claim to be very well versed in it, but it seems to be a research program in its early days. I think that by now, even its practitioners are beginning to realise that simply asking people, outside of any particular context, about their “intuitions” about some concept of philosophical interest is not really going to be informative since without any philosophical background to the question, the respondents themselves can’t really know just what question they are being asked to answer, what their responses are responses to. There are just too many different things that can be meant by a question like, “‘Was such-and-such an action intentional or not?”, for example. And without further discussion or further analysis, the experimenters themselves can’t know what answers they are being given by the respondents. It’s not good data. So I can imagine experimental philosophy evolving in a way to account for this, and starting to include some philosophical background to the investigation, perhaps even some philosophical history, to provide the needed context to the particular intuitions that they are trying to expose and test for. At that point, the experimental situation might also become less one-sided, with a researcher examining a respondent, and could allow for the experimental subjects themselves to ask questions of the experimenters, including questions of clarification and disambiguation, and perhaps even challenges to the way the experimenter has framed the questions.
Later it might be found useful to conduct such experiments in small groups rather than individually, with one experimenter and one subject, and instead the respondents could be encouraged to discuss the questions among themselves as well as with the experimenter. People could meet in these groups two or three times a week and perhaps some relevant reading could be assigned, to clarify and expand upon the question, and the respondents would be given time to do the reading, and asked to write something later on about the question in connection with the reading and the discussions they have had. Then the experimenter could provide “comments” on this writing for the experimental subjects themselves. I think grading the results would be optional in such an arrangement, and probably of no experimental interest, but other than that I think something like this could be the future of experimental philosophy. It’s worth trying anyway.