Skip to main content
Log in

The Role of Evaluation-Driven Rejection in the Successful Exploration of a Conceptual Space of Stories

  • Published:
Minds and Machines Aims and scope Submit manuscript

Abstract

Evaluation processes are a basic component of creativity. They guide not only the pure judgement about a new artefact but also the generation itself, as creators constantly evaluate their own work. This paper proposes a model for automatic story generation based on the evaluation of stories. A model of how quality in stories is evaluated is presented, and two possible implementations of the generation guided by this evaluation are shown: exhaustive space exploration and constrained exploration. A theoretical model and its implementation are explained and validation of the evaluation function through comparison with human criteria is described.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. These templates define relationships between particular actions and the set of arguments that are valid for them, and thereby encode the semantic constraints that people associate with particular terms.

References

  • Boden, M. (1999). Computational models of creativity. Handbook of creativity (pp. 351–373). Cambridge: Cambridge University Press.

  • Boden, M. (2003). Creative mind: Myths and mechanisms (p. 10001). New York, NY: Routledge.

    Google Scholar 

  • Bringsjord, S., & Ferrucci, D. (1999). Artificial intelligence and literary creativity: Inside the mind of Brutus, a storytelling machine. Hillsdale, NJ: Lawrence Erlbaum Associates .

    Google Scholar 

  • Gervás, P. (2009) . Computational approaches to storytelling and creativity. AI Magazine, 30(3), 49–63.

    Google Scholar 

  • Graesser, A. C., Singer, M., & Trabasso, T. (1994). Constructing inferences during narrative text comprehension. Psychological Review, 101, 371–395.

    Google Scholar 

  • Jennings, K. (2008). Developing creativity. Artificial barriers in artificial intelligence. In Proceedings of international joint workshop on computational creativity.

  • Johnson-Laird, P. N. (1987). Mental models in cognitive science. In A. P. Sage (Ed.), System design for human interaction (pp. 17–39). IEEE Press.

  • Johnson-Laird, P. N. (2002). How jazz musicians improvise. Music Perception, 19(3), 415–442.

    Article  Google Scholar 

  • Lebowitz, M. (1987). Storytelling and generalization. In In Annual conference of the cognitive science society (pp. 100–109). Berkeley, CA.

  • Lenat, D. B. (1983). Eurisko: A program that learns new heuristics and domain concepts. Artificial Intelligence, 21(1), 61–98.

    Article  Google Scholar 

  • Mateas, M., & Stern, A. (2005). Structuring content in the Façade interactive drama architecture. In Proceedings of AIIDE, pp. 93–98.

  • Meehan, J. (1976). The metanovel: Writing stories by computer. PhD thesis, Yale University.

  • Niehaus, J., & Young, R. M. (2009). A computational model of inferencing in narrative. In Intelligent Narrative Technologies II. AAAI Press.

  • Peinado, F., & Gervás, P. (2006). Evaluation of automatic generation of basic stories. New Generation Computing, Computational Paradigms and Computational Intelligence. Special issue: Computational Creativity, 24(3), 289–302.

    MATH  Google Scholar 

  • Pérez y, R. (1999). MEXICA: A computer model of creativity in writing. PhD thesis, The University of Sussex.

  • Riedl, M. (2004). Narrative planning: Balancing plot and character. PhD thesis, Department of Computer Science, North Carolina State University.

  • Riedl, M., & Young, R. (2006). Story planning as exploratory creativity: Techniques for expanding the narrative search space. New Generation Computing, Computational Paradigms and Computational Intelligence. Special Issue: Computational Creativity, 24(3), 303–323.

    MATH  Google Scholar 

  • Riedl, M. O., & Young, R. M. (2004). An intent-driven planner for multi-agent story generation. In AAMAS ’04: Proceedings of the 3rd International joint conference on autonomous agents and multiagent systems (pp. 186–193). Washington, DC: IEEE Computer Society.

  • Sawyer, K., John-Steiner, V., Moran,S., Sterberg, R., Feldman, D., Nakamura, J., & Csikszentmihalyi, M. (2003). Creativity and development. Oxford: Oxford University Press.

    Google Scholar 

  • Sharples, M. (1996). An account of writing as creative design. In C. Michael Levy & S. Ransdell (Eds.), The science of writing (pp. 127–148). Lawrence Erlbaum.

  • Sharples, M. (1999). How we write. London: Routledge.

    Google Scholar 

  • Turner, S. (1992). MINSTREL: A computer model of creativity and storytelling. PhD thesis, University of California, Los Angeles, CA.

  • Weyhrauch, P. (1997). Guiding interactive drama. PhD thesis, Computer Science, Carnegie Mellon University, Pittsburgh, PA.

  • Wielemaker, J. (2010). SWI-Prolog. http://www.swi-prolog.org/.

  • Wiggins, G. (2006a). A preliminary framework for description, analysis and comparison of creative systems. Knowledge-Based Systems, 19(7), 449–458.

    Google Scholar 

  • Wiggins G. (2006b). Searching for computational creativity. New Generation Computing, Computational Paradigms and Computational Intelligence. Special Issue: Computational Creativity, 24(3), 209–222.

    MATH  Google Scholar 

Download references

Acknowledgments

This research is funded by the Ministerio de Investigación, Ciencia e Innovación (MILES: TIN2009-14659-C03, GALANTE: TIN2006-14433-C02-01), Universidad Complutense de Madrid and Dirección General de Universidades e Investigación de la Comunidad de Madrid (IVERNAO: CCG08-UCM/TIC-4300) and by the Creation and Consolidation of Research Groups Program by Banco Santader Central Hispano-Universidad Complutense.

Thanks to anonymous reviewers for invaluable comments which have improved this paper greatly and have given us many ideas for the further development of this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Carlos León.

Rights and permissions

Reprints and permissions

About this article

Cite this article

León, C., Gervás, P. The Role of Evaluation-Driven Rejection in the Successful Exploration of a Conceptual Space of Stories. Minds & Machines 20, 615–634 (2010). https://doi.org/10.1007/s11023-010-9205-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11023-010-9205-z

Keywords

Navigation