DOI:
Citation: Dargahi, R.,(2021). Who is talking to me? The role of feedback in a crowdsourced ideation process. SAM Advanced Management Journal, 86(4),58-70.
Online crowdsourcing communities have become a ubiquitous tool for companies to initiate social interaction with the crowd to take advantage of their opinions, ideas, or solutions. In such communities, individuals are able to participate in the new product development process and play an influential role. In this regard, establishing a communication mechanism, also known as an online feedback system, seems critical. This research investigates the effect of feedback source (expert vs. peer) and feedback sign (negative vs. positive) on the motivation of individuals and the innovativeness level of their ideas generated in an online crowdsourced ideation process. This study’s findings indicate that providing feedback –compared to no feedback and negative feedback from a company’s expert- motivate more individuals to generate ideas and improve their submissions’ innovativeness level.
Adamczyk, S., Bullinger, A. C., & Möslein, K. M. (2012). Innovation contests: A review, classification and outlook. Creativity and Innovation Management, 21(4), 335–360. https://doi.org/10.1111/caim.12003
Amabile, T. M. (1979a). Creativity and innovation in organizations (pp. 1–15). Retrieved from Harvard Business School website: https://edisciplinas.usp.br/pluginfile.php/4927750/mod_resource/content/0/Creativity%20and%20Innovation%20in%20Organizations.pdf
Amabile, T. M. (1979b). Effects of external evaluation on artistic creativity. Journal of Personality and Social Psychology, 37(2), 221–233. https://doi.org/10.1037/0022-3514.37.2.221
Amabile, T. M., & Gryskiewicz, S. S. (1987). Creativity in the R&D laboratory. In Harvard Business School. Retrieved from Center for Creative Leadership website: https://www.hbs.edu/faculty/Pages/item.aspx?num=7406
Anderson, S., & Rodin, J. (1989). Is bad news always bad?: Cue and feedback effects on intrinsic motivation. Journal of Applied Social Psychology, 19(6), 449–467. https://doi.org/10.1111/j.1559-1816.1989.tb00067.x
Barrick, M. R., Mount, M. K., & Strauss, J. P. (1993). Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. Journal of Applied Psychology, 78(5), 715–722. https://doi.org/10.1037/0021-9010.78.5.715
Bourne Jr., L. E., & Bunderson, C. V. (1963). Effects of delay of informative feedback and length of postfeedback interval on concept identification. Journal of Experimental Psychology, 65(1), 1–5. https://doi.org/10.1037/h0046994
Brabham, D. C. (2012). A model for leveraging online communities. In A. Delwiche & J. Jacobs Henderson (Eds.), The Participatory Cultures Handbook. New York: Routledge.
Brett, J. F., & Atwater, L. E. (2001). 360° Feedback: Accuracy, reactions, and perceptions of usefulness. Journal of Applied Psychology, 86(5), 930–942. https://doi.org/10.1037/0021-9010.86.5.930
Bullinger, A. C., Neyer, A.-K., Rass, M., & Moeslein, K. M. (2010). Community-Based innovation contests: Where competition meets cooperation. Creativity and Innovation Management, 19(3), 290–303. https://doi.org/10.1111/j.1467-8691.2010.00565.x
Camacho, L. M., & Paulus, P. B. (1995). The role of social anxiousness in group brainstorming. Journal of Personality and Social Psychology, 68(6), 1071–1080. https://doi.org/10.1037/0022-3514.68.6.1071
Campion, M. A., & Lord, R. G. (1982). A control systems conceptualization of the goal-setting and changing process. Organizational Behavior and Human Performance, 30(2), 265–287. https://doi.org/10.1016/0030-5073(82)90221-5
Carter, N. (1991). Learning to measure performance: The use of indicators in organizations. Public Administration, 69(1), 85–101. https://doi.org/10.1111/j.1467-9299.1991.tb00783.x
Chang, W., & Taylor, S. A. (2016). The effectiveness of customer participation in new product development: A meta-analysis. Journal of Marketing, 80(1), 47–64. https://doi.org/10.1509/jm.14.0057
Collins, M. A., & Amabile, T. M. (1999). I5 motivation and creativity. In R. J. Sternberg (Ed.), Handbook of Creativity. Cambridge: University Press.
Connolly, T., Jessup, L. M., & Valacich, J. S. (1990). Effects of anonymity and evaluative tone on idea generation in computer-mediated groups. Management Science, 36(6), 689–703. https://doi.org/10.1287/mnsc.36.6.689
Crumlish, C., & Malone, E. (2009). Designing social interfaces: Principles, patterns, and practices for improving the user experience. Bejing: Oŕeilly.
Dargahi, R. (2019). Summary brief: How to design an online crowdsourcing contest? Society for Marketing Advances Proceedings, 499–506. Westerville: Society for Marketing Advances.
Dargahi, R., & Namin, A. (2020). Making more in crowdsourcing contests: a choice model of idea generation and feedback type. Journal of Marketing Communications, 27(6), 1–24. https://doi.org/10.1080/13527266.2020.1748094
Djelassi, S., & Decoopman, I. (2013). Customers’ participation in product development through crowdsourcing: Issues and implications. Industrial Marketing Management, 42(5), 683–692. https://doi.org/10.1016/j.indmarman.2013.05.006
Fedor, D. B., Davis, W. D., Maslyn, J. M., & Mathieson, K. (2001). Performance improvement efforts in response to negative feedback: The roles of source power and recipient self-esteem. Journal of Management, 27(1), 79–97. https://doi.org/10.1177/014920630102700105
Fishbach, A., Eyal, T., & Finkelstein, S. R. (2010). How positive and negative feedback motivate goal pursuit. Social and Personality Psychology Compass, 4(8), 517–530. https://doi.org/10.1111/j.1751-9004.2010.00285.x
Fuller, J., Bartl, M., Ernst, H., & Muhlbacher, H. (2004). Community based innovation: a method to utilize the innovative potential of online communities. 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of The, 2004. https://doi.org/10.1109/hicss.2004.1265464
Goldsmith, R. E., & Foxall, G. R. (2003). The measurement of innovativeness. In L. V. Shavinina (Ed.), The International Handbook on Innovation. Retrieved from https://doi.org/10.1016/B978-0-08-044198-6.X5000-1
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Hoornaert, S., Ballings, M., Malthouse, E. C., & Van den Poel, D. (2017). Identifying new product ideas: Waiting for the wisdom of the crowd or screening ideas in real time. Journal of Product Innovation Management, 34(5), 580–597. https://doi.org/10.1111/jpim.12396
Howe, J. (2006). The rise of crowdsourcing. Wired Magazine, 1–4. Retrieved from https://www.wired.com/2006/06/crowds/
Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979). Consequences of individual feedback on behavior in organizations. Journal of Applied Psychology, 64(4), 349–371. https://doi.org/10.1037/0021-9010.64.4.349
Jung, J. H., Schneider, C., & Valacich, J. (2010). Enhancing the motivational affordance of information systems: The effects of real-time performance feedback and goal setting in group collaboration environments. Management Science, 56(4), 724–742. https://doi.org/10.1287/mnsc.1090.1129
Katila, R., & Ahuja, G. (2002). Something old, something new: A longitudinal study of search behavior and new product introduction. Academy of Management Journal, 45(6), 1183–1194. https://doi.org/10.5465/3069433
Kittur, A., & Kraut, R. E. (2008). Harnessing the wisdom of crowds in wikipedia. Proceedings of the ACM 2008 Conference on Computer Supported Cooperative Work – CSCW ’08, 37–46. https://doi.org/10.1145/1460563.1460572
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284. https://doi.org/10.1037/0033-2909.119.2.254
Krippendorff, K. H. (2013). Content analysis : An introduction to its methodology (3rd ed.). Thousand Oaks: Sage Publications, Inc.
Lewin, K., Dembo, T., Festinger, L., & Sears, P. S. (1944). Level of aspiration. In Personality and the Behavior Disorders (pp. 333–378). Ronald Press.
Li, C.-Y. (2013). Persuasive messages on information system acceptance: A theoretical extension of elaboration likelihood model and social influence theory. Computers in Human Behavior, 29(1), 264–275. https://doi.org/10.1016/j.chb.2012.09.003
Locke, E. A. (1968). Toward a theory of task motivation and incentives. Organizational Behavior and Human Performance, 3(2), 157–189. https://doi.org/10.1016/0030-5073(68)90004-4
Locke, E. A., & Latham, G. P. (1990). A theory of goal setting & task performance. Englewood Cliffs: Prentice Hall.
Lunenburg, F. C. (2012). Power and leadership: An influence process. International Journal of Management, Business, and Administration, 15(1), 1–9.
Nadler, D. A. (1979). The effects of feedback on task group behavior: A review of the experimental research. Organizational Behavior and Human Performance, 23(3), 309–338. https://doi.org/10.1016/0030-5073(79)90001-1
Nease, A. A., Mudgett, B. O., & Quiñones, M. A. (1999). Relationships among feedback sign, self-efficacy, and acceptance of performance feedback. Journal of Applied Psychology, 84(5), 806–814. https://doi.org/10.1037/0021-9010.84.5.806
Nishikawa, H., Schreier, M., & Ogawa, S. (2013). User-generated versus designer-generated products: A performance assessment at Muji. International Journal of Research in Marketing, 30(2), 160–167. https://doi.org/10.1016/j.ijresmar.2012.09.002
Piller, F. T., & Walcher, D. (2006). Toolkits for idea competitions: A novel method to integrate users in new product development. R and D Management, 36(3), 307–318. https://doi.org/10.1111/j.1467-9310.2006.00432.x
Podsakoff, P. M., & Farh, J.-L. (1989). Effects of feedback sign and credibility on goal setting and task performance. Organizational Behavior and Human Decision Processes, 44(1), 45–67. https://doi.org/10.1016/0749-5978(89)90034-4
Poetz, M. K., & Schreier, M. (2012). The value of crowdsourcing: Can users really compete with professionals in generating new product ideas? Journal of Product Innovation Management, 29(2), 245–256. https://doi.org/10.1111/j.1540-5885.2011.00893.x
Preece, J., & Maloney-Krichmar, D. (2005). Online communities: Design, theory, and practice. Journal of Computer-Mediated Communication, 10(4). https://doi.org/10.1111/j.1083-6101.2005.tb00264.x
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037//0003-066x.55.1.68
Shalley, C. E., & Perry-Smith, J. E. (2001). Effects of social-psychological factors on creative performance: The role of informational and controlling expected evaluation and modeling experience. Organizational Behavior and Human Decision Processes, 84(1), 1–22. https://doi.org/10.1006/obhd.2000.2918
Simula, H., & Vuori, M. (2012). Benefits and barriers of crowdsourcing in B2B firms: Generating ideas with internal and external crowds. International Journal of Innovation Management, 16(06). https://doi.org/10.1142/s1363919612400117
Ulrich, K. T., & Eppinger, S. D. (2011). Product design and development (2nd ed.). New York: Mcgraw-Hill.
Valacich, J. S., Dennis, A. R., & Connolly, T. (1994). Idea generation in computer-based groups: A new ending to an old story. Organizational Behavior and Human Decision Processes, 57(3), 448–467. https://doi.org/10.1006/obhd.1994.1024
Valacich, J. S., Jung, J. H., & Looney, C. A. (2006). The effects of individual cognitive ability and idea stimulation on idea-generation performance. Group Dynamics: Theory, Research, and Practice, 10(1), 1–15. https://doi.org/10.1037/1089-2699.10.1.1
Van Dijk, D., & Kluger, A. N. (2010). Task type as a moderator of positive/negative feedback effects on motivation and performance: A regulatory focus perspective. Journal of Organizational Behavior, 32(8), 1084–1105. https://doi.org/10.1002/job.725
Von Hippel, E. (2006). Democratizing innovation. Cambridge: MIT Press.
Wang, X., Schneider, C., & Valacich, J. S. (2015). Enhancing creativity in group collaboration: How performance targets and feedback shape perceptions and idea generation performance. Computers in Human Behavior, 42, 187–195. https://doi.org/10.1016/j.chb.2014.02.017
West, J., & Bogers, M. (2013). Leveraging external sources of innovation: A review of research on open innovation. Journal of Product Innovation Management, 31(4), 814–831. https://doi.org/10.1111/jpim.12125
Wooten, J. O., & Ulrich, K. T. (2011). Idea generation and the role of feedback: Evidence from field experiments with innovation tournaments. Production and Operations Management, 26(1), 80–99. https://doi.org/10.1111/poms.12613
Yang, Y., Chen, P. Y., & Pavlou, P. (2009). Open innovation: An empirical study of online contests. International Conference on Information Systems Proceedings, 13. International Conference on Information Systems.
Zhou, J. (1998). Feedback valence, feedback style, task autonomy, and achievement orientation: Interactive effects on creative performance. Journal of Applied Psychology, 83(2), 261–276. https://doi.org/10.1037/0021-9010.83.2.261
Zhou, J., & George, J. M. (2001). When job dissatisfaction leads to creativity: Encouraging the expression of voice. Academy of Management Journal, 44(4), 682–696. https://doi.org/10.5465/3069410
Zuchowski, O., Posegga, O., Schlagwein, D., & Fischbach, K. (2016). Internal crowdsourcing: Conceptual framework, structured review, and research agenda. Journal of Information Technology, 31(2), 166–184. https://doi.org/10.1057/jit.2016.14