Off-campus access
Using PhilPapers from home?
Click here to configure this browser for off-campus access.
- Stephen E. Newstead, Peter Bradon, Simon J. Handley, Ian Dennis & Jonathan St B. T. Evans (2006). Predicting the Difficulty of Complex Logical Reasoning Problems. Thinking and Reasoning 12 (1):62 – 90.The aim of the present research was to develop a difficulty model for logical reasoning problems involving complex ordered arrays used in the Graduate Record Examination. The approach used involved breaking down the problems into their basic cognitive elements such as the complexity of the rules used, the number of mental models required to represent the problem, and question type. Weightings for these different elements were derived from two experimental studies and from the reasoning literature. Based on these weights, difficulty models were developed which were then tested against new data. The models had excellent predictive validity and showed the relative influence of rule based factors and factors relating to the number of underlying models. Different difficulty models were needed for different question types, suggesting that people used a variety of approaches and, at a wider level, that both mental models and mental rules may be used in reasoning.No categories
Similar books and articles
An experiment is reported examining dual-process models of belief bias in syllogistic reasoning using a problem complexity manipulation and an inspection-time method to monitor processing latencies for premises and conclusions. Endorsement rates indicated increased belief bias on complex problems, a finding that runs counter to the “belief-first” selective scrutiny model, but which is consistent with other theories, including “reasoning-first” and “parallel-process” models. Inspection-time data revealed a number of effects that, again, arbitrated against the selective scrutiny model. The most striking inspection-time result was an interaction between logic and belief on premise-processing times, whereby belief - logic conflict problems promoted increased latencies relative to non-conflict problems. This finding challenges belief-first and reasoning-first models, but is directly predicted by parallel-process models, which assume that the outputs of simultaneous heuristic and analytic processing streams lead to an awareness of belief - logic conflicts than then require time-consuming resolution.
Current theories of reasoning such as mental models or mental logic assume a universal cognitive mechanism that underlies human reasoning performance. However, there is evidence that this is not the case, for example, the work of Ford (1995), who found that some people adopted predominantly spatial and some verbal strategies in a syllogistic reasoning task. Using written and think-aloud protocols, the present study confirmed the existence of these individual differences. However, in sharp contrast to Ford, the present study found few differences in reasoning performance between the two groups, in terms of accuracy or type of conclusion generated. Hence, reasoners present an outward appearance of ubiquity, despite underlying differences in reasoning processes. These findings have implications for theoretical accounts of reasoning, and for attempts to model reasoning data. Any comprehensive account needs to account for strategic differences and how these may develop in logically untrained individuals.
No categories
From its beginnings in Aristotle, logic was intended to account not only for reasoning that is theoretical (or conclusion-oriented), but for reasoning that is practical (or actionoriented). However, despite an interest in the topic that continues to the present, the practical side of reasoning has remained broadly speculative. At least in some domains (mathematics, in particular), there are well developed proof-theoretic and semantic theories that yield quite detailed models of correct reasoning, and these models are useful for both theoretical and practical purposes. In contrast, the logical work on practical reasoning has remained broadly speculative and disengaged from applications. Logical formalisms have not been forthcoming that would be useful either in designing an agent that needs to act intelligently, or in helping an intelligent agent to evaluate its reasoning about action.
No categories
Two experiments investigated the mental representation of spatial and nonspatial two-dimensional problems. The experiments were designed to contrast opposite predictions of the model theory of reasoning and the formal rules of inference theories. Half of the problems required more inferential steps but only one model, whereas the other half required fewer inferential steps but two models. According to the inference rules, theory problems that require more inferential steps should be harder, whereas the model-based theory predicts that problems that require two models should be harder. In Experiments 1a and 1b we measured the problem solving time and the percentage of errors. In Experiments 2a and 2b the problems were presented segmented in two different displays. We measured the comprehension time for each display, the question answering times, and the percentage of errors. The results of all experiments supported the model theory predictions in both spatial and nonspatial domains.
No categories
This paper examines the nature of model-based reasoning in the interplay between theory and experiment in the context of biomedical engineering research laboratories, where problem solving involves using physical models. These "model systems" are sites of experimentation where in vitro models are used to screen, control, and simulate specific aspects of in vivo phenomena. As with all models, simulation devices are idealized representations, but they are also systems themselves, possessing engineering constraints. Drawing on research in contemporary cognitive science that construes cognition as occurring in a complex distributed system comprising people and artifacts, I argue that reasoning with model systems is a constraint satisfaction process involving co-construction, manipulation, and revision of mental and physical models.
Researchers currently working on relational reasoning typically argue that mental model theory (MMT) is a better account than the inference rule approach (IRA). They predict and observe that determinate (or one-model) problems are easier than indeterminate (or two-model) problems, whereas according to them, IRA should lead to the opposite prediction. However, the predictions attributed to IRA are based on a mistaken argument. The IRA is generally presented in such a way that inference rules only deal with determinate relations and not with indeterminate ones. However, (a) there is no reason to presuppose that a rule-based procedure could not deal with indeterminate relations, and (b) applying a rule-based procedure to indeterminate relations should result in greater difficulty. Hence, none of the recent articles devoted to relational reasoning currently presents a conclusive case for discarding IRA by using the well-known determinate vs indeterminate problems comparison.
According to the mental models theory, reasoning performance is primarily influenced by the number of models of a problem that can be constructed. This study investigates whether the content of the model may also influence performance. Linear reasoning problems were devised that either described a believable (script-consistent) or an unbelievable (script-inconsistent) order of actions. The results of two experiments showed that conclusions were inferred more slowly and less accurately on the basis of an unbelievable model than on a believable one. Experiment 2 revealed that script knowledge facilitated as well as impeded reasoning performance. Conclusion evaluation was faster and more accurately for script-consistent problems than for neutral problems, whereas model construction and conclusion evaluation occurred respectively more slowly and less accurately for script-inconsistent problems than for neutral problems. These results show that the content of the model is a noteworthy factor influencing reasoning performance.
This article reports on a study of children's deductive reasoning in solving novel relational problems. Detailed protocols were obtained from 264 children (aged 9- 12 years) who verbalised their thinking as they solved the problems. The study included the development of a three-phase theory based on Johnson-Laird and Byrne's mental models perspective, but with some distinct modifications. These include a focus on the relational complexity entailed in model construction and in premise integration, and the advancement of four reasoning principles that are applied throughout problem solution (in contrast to Johnson-Laird's falsification processes as the hallmark of deductive reasoning). The reported case studies and the results of statistical analyses supported predictions arising from the proposed theory, including the key role of the reasoning principles. The results also showed that problem difficulty is a function of relational complexity, not of the number of models to be constructed, as argued by Johnson-Laird and Byrne.
No categories
Johnson-Laird (1983) has argued that spatial reasoning is based on the construction and manipulation of mental models in memory. The present article addresses the question of whether reasoning about time relations is constrained by the same factors as reasoning about spatial relations. An experiment is reported that explored the similarities and the differences in the performance of subjects in comparable spatial and temporal reasoning tasks. The results indicated that, in both the temporal and the spatial content domains, the data were in agreement with the view that subjects solved problems by constructing models in memory rather than with a logical rule conceptualisation of reasoning. An analysis of the premise-reading times on the basis of premise-linking order provided support for an on-line process of mental models construction, and offered an explanation for the finding that spatial problems that did require an inference of transitivity were easier than problems that did not. No essential differences in processing and performance were observed across the two content domains, although in the time domain the correctness data were in agreement with both the mental models theory and the logical rules view. The results are discussed with respect to the mental models theory and the structural characteristics of the problems.
No categories
We report the results of three experiments designed to assess the role of suppositions in human reasoning. Theories of reasoning based on formal rules propose that the ability to make suppositions is central to deductive reasoning. Our first experiment compared two types of problem that could be solved by a suppositional strategy. Our results showed no difference in difficulty between problems requiring affirmative or negative suppositions and very low logical solution rates throughout. Further analysis of the error data showed a pattern of responses, which suggested that participants reason from a superficial representation of the premises in these arguments and this drives their choice of conclusion. Our second experiment employed a different set of suppositional problems but with extremely similar proofs in terms of the rules applied and number of inferential steps required. As predicted by our interpretation of reasoning strategies employed in Experiment 1, logical performance was very much higher on these problems. Our third experiment showed that problems that could be solved by constructing an initial representation of the premises were easier than problems in which this representation was not sufficient. This effect was independent of the suppositional structure of the problems. We discuss the implications of this research for theories of reasoning based on mental models and inference rules.
No categories
Discussion of Stephen E. Newstead , Peter Bradon , Simon J. Handley , Ian Dennis & Jonathan St B. T. Evans, Predicting the difficulty of complex logical reasoning problems
|
|
There are no threads in this forum |
Nothing in this forum yet.

