Cited by 235Artificial Intelligence ApplicationsTopic ModelingNatural Language Processing Techniques

Artificial Intelligence Prompt Engineering as a New Digital Competence: Analysis of Generative AI Technologies Such as ChatGPT

Open access
Korzynski, Pawel, Mazurek, Grzegorz, Krzypkowska, Pamela, Kurasinski, Artur·2023·Entrepreneurial Business and Economics Review

Abstract

Objective: The article aims to offer a thorough examination and comprehension of the challenges and prospects connected with artificial intelligence (AI) prompt engineering.Our research aimed to create a theoretical framework that would highlight optimal approaches in the field of AI prompt engineering. Research Design & Methods:This research utilized a narrative and critical literature review and established a conceptual framework derived from existing literature taking into account both academic and practitioner sources.This article should be regarded as a conceptual work that emphasizes the best practices in the domain of AI prompt engineering.Findings: Based on the conducted deep and extensive query of academic and practitioner literature on the subject, as well as professional press and Internet portals, we identified various insights for effective AI prompt engineering.We provide specific prompting strategies. Implications & Recommendations:The study revealed the profound implications of AI prompt engineering across various domains such as entrepreneurship, art, science, and healthcare.We demonstrated how the effective crafting of prompts can significantly enhance the performance of large language models (LLMs), generating more accurate and contextually relevant results.Our findings offer valuable insights for AI practitioners, researchers, educators, and organizations integrating AI into their operations, emphasizing the need to invest time and resources in prompt engineering.Moreover, we contributed the AI PROMPT framework to the field, providing clear and actionable guidelines for text-to-text prompt engineering. Contribution & Value Added:The value of this study lies in its comprehensive exploration of AI prompt engineering as a digital competence.By building upon existing research and prior literature, this study aimed to provide a deeper understanding of the intricacies involved in AI prompt engineering and its role as a digital competence.

AI snapshot

Written from the paper’s full text.

TL;DR

This conceptual paper argues that AI prompt engineering should be understood as a new digital competence and offers a framework of best practices for interacting with generative AI such as ChatGPT. It synthesizes academic and practitioner literature to propose the AI PROMPT framework and to map prompt engineering onto the DigComp digital competence areas.

Key findings

  • AI prompt engineering is framed as a human-language-focused digital competence, not merely a technical IT skill, and is analyzed through DigComp’s five core areas: information and data literacy, communication and collaboration, digital content creation, safety, and problem-solving.
  • The paper identifies prompting strategies for text-to-image and text-to-text models, including using varied adjectives, specifying image quality/style/artist references, limiting images to no more than 2–4 objects, and structuring text prompts with context, instruction, input data, and expected output format.
  • It proposes the AI PROMPT framework for text-to-text prompting: Articulate the instruction; Indicate the prompt elements; Provide ending cues and context; Refine instructions to avoid ambiguity; Offer feedback and examples; Manage interaction; Track token length and task complexity.
  • Reported challenges include LLM hallucination, “stochastic parrots,” and non-AI experts struggling with end-user prompt engineering; the paper also notes prompt engineering applications in entrepreneurship, art, science, and healthcare, and cites prompt engineering salaries up to 335,000 USD.

Methods

  • Design: narrative and critical literature review following Ratten (2023), described by the authors as a conceptual work emphasizing best practices in AI prompt engineering.
  • Data/sources: academic and practitioner literature, professional press, Internet portals, and desk research; the authors created a list of themes related to prompt engineering techniques, technological challenges, and domain applications.
  • Analysis: conceptual framework development, including application of the DigComp framework to AI prompt engineering and creation of the AI PROMPT framework with examples from business settings.

Limitations

  • The paper states it “should be regarded as a conceptual work” and uses a narrative and critical literature review rather than an empirical study.
  • No formal limitations section is provided; evident from the text, the study lacks empirical validation, a systematic review protocol, and reported search criteria or sample selection procedures.
  • The paper relies on existing literature and practitioner sources, so its proposed frameworks and examples are not tested with original data or controlled comparisons.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.15678/eber.2023.110302

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 37 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    Non-AI-experts struggle to engage in end-user prompt engineering effectively, often lacking systematic approaches and overgeneralizing their experiences.

    “Zamfirescu-Pereira, Wong, Hartmann, and Yang (2023) found that non-AI-experts struggled to engage in end-user prompt engineering effectively, often lacking systematic approaches and overgeneralizing their experiences.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zamfirescu-Pereira, Wong, Hartmann, and Yang, 2023

      Not checked in the free run.

  • Interpretationnone given

    The effective crafting of prompts can significantly enhance the performance of large language models, generating more accurate and contextually relevant results.

    “We demonstrated how the effective crafting of prompts can significantly enhance the performance of large language models (LLMs), generating more accurate and contextually relevant results.”
    Quote in the paperNot a substantial claim
  • Premisecitation

    LLMs can be effectively used to produce entrepreneurial rhetoric by mimicking celebrity CEO archetypes.

    “Short and Short (2023) demonstrated how LLMs can be effectively used to produce entrepreneurial rhetoric by mimicking celebrity CEO archetypes.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Short and Short, 2023

      Not checked in the free run.

  • Premisecitation

    ChatGPT suffers from hallucination problems, generating plausible-sounding but incorrect or unsupported information in its responses.

    “Bang et al. (2023) found that similarly to other LLMs, ChatGPT suffers from hallucination problems that refer to the phenomenon of LLMs generating plausible-sounding but incorrect or unsupported information in their responses.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bang et al., 2023

      Not checked in the free run.

  • Premisecitation

    Performance in zero-shot settings often lags behind supervised counterparts.

    “However, performance in zeroshot settings often lags behind supervised counterparts, leaving room for potential improvement (Zhou, He, Ma, Berg-Kirkpatrick, & Neubig, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zhou, He, Ma, Berg-Kirkpatrick, & Neubig, 2022

      Not checked in the free run.

  • Classified as probably not a substantial claim. 66
  • May combine two claims. 15
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Findingnone given

    This prompt is more abstract, potentially yielding surprising and inspirational results for further exploration.

    “This prompt is more abstract, potentially yielding surprising and inspirational results for further exploration.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Findingreasoning

    This prompt offers a precise description leading to more predictable and concrete imagery.

    “This prompt offers a precise description leading to more predictable and concrete imagery.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Findingreasoning

    The instruction 'Briefly and without unnecessary details' is not a clear instruction.

    “'Briefly and without unnecessary details' is not a clear instruction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    The prompt example 'Tell me what prompt engineering is. Write briefly and without unnecessary details.' does not provide a clear structure for the response and does not indicate the intended audience.

    “This example does not provide a clear structure for the response, nor does it indicate the intended audience.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    The prompt example 'Write a 3-5 sentence explanation of what prompt engineering is. Write the response as if it were directed to a high school student.' provides a clear response structure and specifies the intended audience, signaling the required tone and vocabulary.

    “This example provides a clear response structure and specifies the intended audience and thus signals the required tone and vocabulary to use in the response.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Prompt engineering is a creative skill for generating AI art, and expertise and practice are required to master this skill.

    “Oppenlaender, Visuri, Paananen, Linder, and Silvennoinen (2023) investigated prompt engineering as a creative skill for generating AI art, emphasizing that expertise and practice are required to master this skill.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Oppenlaender, Visuri, Paananen, Linder, and Silvennoinen, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Prompt engineering allows for greater control over the output, as the right prompts can help ensure AI models create the desired content.

    “It allows for greater control over the output, as the right prompts can help ensure AI models create the desired content.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Digital competences transcend mere technical abilities and represent a complex concept that integrates a wide range of skills, including cognitive, emotional, and sociological knowledge, which are crucial for effectively navigating digital environments.

    “Scholars indicate that digital competences transcend mere technical abilities and represent a complex concept that integrates a wide range of skills, including cognitive, emotional, and sociological knowledge, which are crucial for effectively navigating digital environments (Røkenes & Krumsvik, 2016;Wang, Zhang, Wang, & Li, 2021).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Røkenes & Krumsvik, 2016

      Not checked in the free run.

    • cites Wang, Zhang, Wang, & Li, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    The construction of appropriate prompts depends on the tool used at the moment, even though there are general best practices for visual models.

    “Noteworthy, the construction of appropriate prompts depends on the tool used at the moment, even though there are general best practices for visual models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Prompt engineering concentrates on manually creating and revising prompts, aligning it more with human-centred fields such as human-computer interaction and conversational AI, rather than the general field of machine learning.

    “In contrast to these approaches, prompt engineering concentrates on manually creating and revising prompts, aligning it more with human-centred fields such as human-computer interaction, and conversational AI, rather than the general field of machine learning (Oppenlaender, Linder, & Silvennoinen, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Oppenlaender, Linder, & Silvennoinen, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    An effective prompt may include the following elements: context, instruction, input data, and expected output format.

    “Ultimately, an effective prompt may include the following elements: 1) Context -can include information about the role the model should play for the task or any necessary information about the situation that may ground it ('You are a salesperson in a technology company');”
    • Also stated in: § Text-to-text Prompting · plain
      “2) Instruction -the task to be performed ('Write an email to a customer thanking for high attendance during the last workshop on MLOps'); 3) Input Data -data for few-shot learning or information the model should use to perform the task ('Customer name: XYZ, keywords to include = [future, innovation, parthership]'); 4) Expected output format -information about the format and type of output in which”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The DigComp framework is structured around five core competence areas: information and data literacy, communication and collaboration, digital content creation, safety, and problem-solving.

    “The DigComp framework is structured around five core competence areas.Since 2016, these areas include information and data literacy, communication and collaboration, digital content creation, safety, and problem-solving (VUORIKARI Rina et al., 2022).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites VUORIKARI Rina et al., 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    AI prompt engineering has profound implications across various domains such as entrepreneurship, art, science, and healthcare.

    “The study revealed the profound implications of AI prompt engineering across various domains such as entrepreneurship, art, science, and healthcare.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Zero-shot prompting enables a model to make predictions about previously unseen data without the need for any additional training.

    “Zero-shot prompting enables a model to make predictions about previously unseen data without the need for any additional training.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zhou, He, Ma, Berg-Kirkpatrick, & Neubig, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Building prompts for text-to-image models is conceptually simpler than for text-to-text models, as the number of tasks is limited in their case.

    “Building prompts for text-to-image models is conceptually simpler than for text-to-text models, as the number of tasks is limited in their case.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Digital competences consist of a blend of knowledge, skills, and attitudes encompassing concepts, facts, skill descriptions, and attitudes.

    “Digital competences consist of a blend of knowledge, skills, and attitudes encompassing concepts, facts, skill descriptions (for example, the capability to execute processes), and attitudes (such as a mindset or inclination to take action) (VUORIKARI Rina, Kluzer, & Punie, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites VUORIKARI Rina, Kluzer, & Punie, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    Effective prompts contribute to improved accuracy by guiding AI models to generate more relevant and valuable content.

    “Additionally, effective prompts contribute to improved accuracy by guiding AI models to generate more relevant and valuable content.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The interactive feature of ChatGPT enables human collaboration with the underlying LLM to improve its performance through a multi-turn 'prompt engineering' fashion.

    “However, the interactive feature of ChatGPT enables human collaboration with the underlying LLM to improve its performance through a multi-turn 'prompt engineering' fashion, i.e. an interactive approach in which users iteratively engage with a large language model (LLM) like ChatGPT in a conversational manner.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The DigComp framework offers a more in-depth and structured approach to understanding digital competence.

    “One of the most comprehensive developments in this area is the DigComp framework which offers a more in-depth and structured approach to understanding digital competence (Reisoğlu & Çebi, 2020).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Reisoğlu & Çebi, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    AI generative technologies, such as ChatGPT or Bard, have significantly impacted the business landscape, transforming the way organizations operate, communicate, and innovate.

    “Furthermore, AI generative technologies, such as ChatGPT or Bard, have significantly impacted the business landscape, transforming the way organizations operate, communicate, and innovate (Korzynski, Kozminski, & Baczynska, 2023;Wach et al., 2023).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Korzynski, Kozminski, & Baczynska, 2023

      Not checked in the free run.

    • cites Wach et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Reynolds and McDonell (2021) introduced the concept of a 'metaprompt,' which is a higher-order prompt designed to seed the language model to generate its own natural language prompts for a range of tasks.

    “Reynolds and McDonell (2021) introduced the concept of a 'metaprompt,' which is a higher-order prompt designed to seed the language model to generate its own natural language prompts for a range of tasks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reynolds and McDonell, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    LLMs have legal and ethical risks, including stochastic parrots.

    “Li (2023) highlighted the legal and ethical risks associated with LLMs, including stochastic parrots.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Li, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    AI prompt engineering has emerged as a critical aspect of interacting with large language models (LLMs) such as ChatGPT.

    “In recent years, AI prompt engineering has emerged as a critical aspect of interacting with large language models (LLMs) such as ChatGPT.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    For models returning text, the creation of prompts usually relies on the desire to solve a specific language task, therefore, the prompt architecture differs from task to task.

    “For models returning text, the creation of prompts usually relies on the desire to solve a specific language task, therefore, the prompt architecture differs from task to task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Prompt engineering can enhance creativity by presenting AI models with new and unique prompts to explore.

    “Furthermore, prompt engineering can enhance creativity by presenting AI models with new and unique prompts to explore (God, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites God, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    If more than 2-4 objects are placed in an image prompt, generators usually start to become less precise and create blurred content.

    “5) We should not place more than 2-4 objects in the image.If the number is higher than the generators usually start to become less precise and create blurred content.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Oppenlaender, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The ChatExtract method using engineered prompts applied to a conversational LLM can accurately extract data from research articles.

    “Polak and Morgan (2023) proposed the ChatExtract method using engineered prompts applied to a conversational LLM for accurate data extraction from research articles.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Polak and Morgan, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The more specific and detailed the prompt is, the greater the chance of getting the desired result.

    “6) It is important to be specific as the more specific and detailed the prompt is, the greater the chance of getting the desired result (Oppenlaender, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Oppenlaender, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Few-shot prompting is a technique in which the model receives a small number of examples, typically between two and five, to quickly adapt to new tasks.

    “Meanwhile, few-shot prompting is a technique, in which the model receives a small number of examples, typically between two and five, to quickly adapt to new tasks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Meyerson et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The metaprompt approach can potentially lead to more accurate and creative results, as the language model leverages its vast knowledge to generate suitable prompts.

    “This approach can potentially lead to more accurate and creative results, as the language model leverages its vast knowledge to generate suitable prompts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    White et al. (2023) presented a catalogue of prompt engineering patterns that can be applied to solve common problems in LLM conversations.

    “White et al. (2023) presented a catalogue of prompt engineering patterns that can be applied to solve common problems in LLM conversations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites White et al., 2023

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    This study highlights the potential for AI prompt engineering to streamline data extraction processes and improve the efficiency of research across scientific disciplines.

    “This study highlights the potential for AI prompt engineering to streamline data extraction processes and improve the efficiency of research across scientific disciplines.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisenone given

    Prompt engineering methods are continually refined to help large language models adapt to new tasks with limited or no supervised training.

    “These methods are being refined continually to help LLMs adapt to new tasks with limited or no supervised training.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    This approach would yield graphics that adhere to a uniform style, thereby establishing a cohesive visual identity for the website.

    “This approach would yield graphics that adhere to a uniform style, thereby establishing a cohesive visual identity for the website (Parsons, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Parsons, 2023

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Prompt engineering skill can lead to more accurate and contextually relevant results, which in turn improves the overall performance and efficiency of AI models.

    “Such a skill can lead to the generation of more accurate and contextually relevant results, which in turn improves the overall performance and efficiency of the AI models.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    In art, prompt engineering allows for new forms of creative expression.

    “In art, it allows for new forms of creative expression.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Ekin (2023) provides a comprehensive guide on prompt engineering techniques, tips, and best practices for ChatGPT.

    “Ekin (2023) provides a comprehensive guide on prompt engineering techniques, tips, and best practices for ChatGPT, a powerful tool in natural language processing (NLP) with applications across various industries.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ekin, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationcitation

    This theme showcases the artistic potential of prompt engineering, opening up new avenues for creative expression and collaboration between humans and AI.

    “This theme showcases the artistic potential of prompt engineering, opening up new avenues for creative expression and collaboration between humans and AI.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    In healthcare, prompt engineering contributes significantly to applications such as question-answering systems, text summarization, and machine translation.

    “Finally, in healthcare, it contributes significantly to applications like question-answering systems, text summarization, and machine translation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Communities such as Learn Prompting provide a thriving environment that fosters learning and growth in the AI field.

    “Such communities provide a thriving environment that fosters learning and growth in the AI field.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Ling et al. (2023) explored the use of reasoning chains as a prompting technique, which leverages structured sequences of related knowledge statements from external knowledge bases to improve the model's performance in open-domain commonsense reasoning tasks.

    “Ling et al. (2023) explored the use of reasoning chains as a prompting technique, which leverages structured sequences of related knowledge statements from external knowledge bases to improve the model's performance in open-domain commonsense reasoning tasks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ling et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    There is a need for digital competences as a core, fundamental literacy addressing both technology mastery and a digital citizenship mindset, especially in higher education.

    “These studies indicate the need for digital competences as a core, fundamental literacy addressing both technology mastery and a digital citizenship mindset, especially in higher education (Martzoukou, Fulton, Kostagiolas, & Lavranos, 2020).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Martzoukou, Fulton, Kostagiolas, & Lavranos, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The DigComp framework acknowledges the critical role digital skills play in the constantly changing digital landscape of today.

    “Created with the purpose of informing and guiding policies to enhance digital competencies for citizens of all age groups, the framework acknowledges the critical role digital skills play in the constantly changing digital landscape of today (Štaka, Vuković, & Vujović, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Štaka, Vuković, & Vujović, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Non-AI experts often struggle with prompt engineering, indicating a need for more accessible and systematic approaches.

    “Furthermore, non-AI experts often struggle with prompt engineering, indicating a need for more accessible and systematic approaches.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The AI PROMPT framework provides clear, actionable recommendations for text-to-text prompt engineering, helping practitioners refine their prompts to elicit better responses from language models.

    “It provides clear, actionable recommendations for text-to-text prompt engineering, thus helping practitioners refine their prompts to elicit better responses from language models.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The majority of studies on digital competences are related to the education industry, focusing on students' and teachers' abilities to use technology effectively in learning and teaching.

    “The majority of studies on digital competences are related to the education industry, focusing on students' and teachers' abilities to use technology effectively in learning and teaching (Fernández-Batanero, Montenegro-Rueda, Fernández-Cerero, & García-Martínez, 2022; Pozo-Sánchez, López-Belmonte, Rodríguez-García, & López-Núñez, 2020) highlighting the need for continued improvement in this area (”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Fernández-Batanero, Montenegro-Rueda, Fernández-Cerero, & García-Martínez, 2022

      Not checked in the free run.

    • cites Pozo-Sánchez, López-Belmonte, Rodríguez-García, & López-Núñez, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    By following the methods, guidelines, and best practices discussed in the article, users can obtain more accurate, relevant, and fitting responses from both text-to-image and text-to-text generative models.

    “By following the methods, guidelines, and best practices discussed in this article, users can acquire more accurate, relevant, and fitting responses from both text-to-image and text-to-text generative models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    This study underscores the potential for AI prompt engineering to revolutionize content creation and communication strategies in the world of entrepreneurship.

    “This study underscores the potential for AI prompt engineering to revolutionize content creation and communication strategies in the world of entrepreneurship.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Challenges remain in prompt engineering, including hallucination problems and the tendency of large language models to mimic and reproduce existing text without deep understanding of the content.

    “However, there are still challenges to be addressed, including hallucination problems and the tendency for LLMs to mimic and reproduce the existing text without a deep understanding of the content.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    In science, prompt engineering can streamline data extraction processes from research articles.

    “In science, it can streamline data extraction processes from research articles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The metaprompt approach aims to leverage the language model's inherent capabilities and understanding of natural language to create more effective and nuanced prompts.

    “The metaprompt approach aims to leverage the language model's inherent capabilities and understanding of natural language to create more effective and nuanced prompts.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reynolds and McDonell, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Prompt engineers will hold an essential position in the realm of artificial intelligence.

    “Although this statement might be somewhat overstated, prompt engineers will undoubtedly hold an essential position in the realm of artificial intelligence.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    The literature focuses strongly on developing prompt engineering techniques such as metaprompts, reasoning chains, and zero-shot and few-shot prompting.

    “The literature reveals a strong focus on the development of prompt engineering techniques, such as the use of metaprompts and reasoning chains, as well as zero-shot and few-shot prompting techniques.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Recently, there has been a surge in the number of text-to-image generation models based on LLM (DALL•E2, Stable Diffusion, Midjourney).

    “Recently, there has been a surge in the number of text-to-image generation models based on LLM (DALL•E2, Stable Diffusion, Midjourney).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Each task is individual and needs a specific matching prompt, so the presented examples should be treated only as a starting point for tests.

    “Remember to treat these examples as a good starting point for tests, as each task is individual and needs a specific matching prompt.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Communities play a pivotal role in the AI and prompt engineering landscape.

    “Communities also play a pivotal role in the AI and prompt engineering landscape.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    By carefully formulating prompts, organizations can derive increased value from their AI systems, because the models will then deliver more precise and helpful outputs.

    “By carefully formulating prompts, these entities can derive increased value from their AI systems, as the models will then deliver more precise and helpful outputs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    In entrepreneurship, prompt engineering can mimic celebrity CEO archetypes, revolutionizing content creation and communication strategies.

    “In entrepreneurship, it can mimic celebrity CEO archetypes revolutionizing content creation and communication strategies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    For conversational models such as ChatGPT, feedback on the model's responses can help it better understand the desired output.

    “For conversational models, such as ChatGPT, feedback on the model's responses can help it better understand the desired output.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Scholars emphasize the importance of critically and reflectively employing technology to generate new insights and knowledge.

    “Moreover, scholars emphasize the importance of critically and reflectively employing technology to generate new insights and knowledge (DeWitt & Alias, 2023;Głodowska, Maciejewski, & Wach, 2023).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites DeWitt & Alias, 2023

      Not checked in the free run.

    • cites Głodowska, Maciejewski, & Wach, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Providing a model with a few examples of expected responses (few-shot learning) can help it adapt its style and way of responding.

    “Moreover, providing the model with a few examples of expected responses (few-shot learning) can help it adapt its style and way of responding.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Open-source frameworks such as OpenPrompt provide an environment for users to learn, experiment, and design their own prompts, fostering the development of prompt engineering skills.

    “They provide a conducive environment for users to learn, experiment, and even design their own prompts, fostering the development of skills in prompt engineering.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Prompt engineering has shown promising results in a variety of domains.

    “Despite these challenges, prompt engineering has shown promising results in a variety of domains.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    In many tasks, several prompt building blocks need to be combined to receive the expected result.

    “In many tasks, we need to combine the following building blocks to receive the expected result.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    The DigComp framework, with its five core competence areas (information and data literacy, communication and collaboration, digital content creation, safety, and problem-solving), provides a valuable lens to understand and improve AI prompt engineering competencies.

    “The DigComp framework, which outlines five core competence areas, i.e. information and data literacy, communication and collaboration, digital content creation, safety, and problem-solving provides a valuable lens to understand and improve AI prompt engineering competencies.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Hallucination and mimicry problems can lead to the generation of false, misleading, biased, or inappropriate information.

    “These issues can lead to the generation of false, misleading, biased, or inappropriate information.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Implementing efficient prompting strategies is essential for improving the performance of large language models in all possible applications.

    “The implementation of efficient prompting strategies is essential for improving the performance of LLMs in all possible applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A wide variety of frameworks and models have been developed and utilized to explore and understand digital competence from different perspectives.

    “Over the years, a wide variety of frameworks and models have been developed and utilized to explore and understand digital competence from different perspectives (Blundell, Mukherjee, & Nykvist, 2022;Guitert, Romeu, & Baztán, 2021;Kelentrić, Helland, & Arstorp, 2017).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Blundell, Mukherjee, & Nykvist, 2022

      Not checked in the free run.

    • cites Guitert, Romeu, & Baztán, 2021

      Not checked in the free run.

    • cites Kelentrić, Helland, & Arstorp, 2017

      Not checked in the free run.

68 of 68
  • The paper relies on this without support.

    Commercially available large language models have a token limit of about 4096 tokens.

    “Remember to control the token length, keeping the prompt and response under the token limits of the model (usually 4096 tokens for commercially available LLMs).”
1 of 1

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Korzynski et al. argue that GenAI prompt engineering is a key graduate skill and present a conceptual framework encompassing different strategies for GenAI prompt engineering.

    “In their review, Korzynski, Mazurek [69] explore GenAI prompt engineering as a digital competency and argue that this is a key graduate skill and present a conceptual framework that encompasses different strategies for GenAI prompt engineering.”

    From Generative AI in Higher Education: Balancing Innovation and Integrity (2025) · cites this paper as Korzynski, Mazurek [69]

    The Materials and Methods section says the authors developed a conceptual framework encompassing different prompt-engineering strategies, and the Abstract describes prompt engineering as a digital competence. The Digital Competences section discusses the importance of digital skills in higher education, but our copy does not specifically argue that prompt engineering is a key graduate skill. No page numbers are available in the indexed passages. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • The same DOI is assigned to two different preprints

    Minor

    References 1 and 45 give different arXiv identifiers and titles but list the same DOI, which contains Reference 1's arXiv identifier. The DOI in Reference 45 is therefore inconsistent with its own identifier.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 5

  1. DeWitt, D., & Alias, N. (2023). Creative Digital Pedagogies for Student Engagement: Preparing Students for Industry 4.0. In Digitalization and Development (pp. 112-132). Routledge.
  2. Kelentrić, M., Helland, K., & Arstorp, A.T. (2017). Professional digital competence framework for teachers. The Norwegian Centre for ICT in Education, 134(1), 1-74.
  3. Korzynski, P., Haenlein, M., & Rautiainen, M. (2021). Video Techniques That Help-or Hurt-Crowdfunding Campaigns. Harvard Business Review, 99(2), 29-29. Retrieved from www.hbr.org on May 10, 2023.
  4. Korzynski, P., Kozminski, A.K., & Baczynska, A.K. (2023). Navigating leadership challenges with technology: Uncovering the potential of ChatGPT, virtual reality, human capital management systems, robotic process automation, and social media. International Entrepreneurship Review, 9(2). https://doi.org/10.15678/IER.2023.0902. · DOI
  5. Zhou, C., He, J., Ma, X., Berg-Kirkpatrick, T., & Neubig, G. (2022). Prompt consistency for zero-shot task generalization. arXiv preprint arXiv:2205.00049. https://doi.org/10.48550/arXiv.2302.04023 Authors Authors' contribution was as follows: Pawel Korzynski (40% -conceptualization, draft, revisions), Grzegorz Mazurek (25% -conceptualization, draft, revisions), Pamela Krzypkowska (25% -draft writing, revisions), Ar- tur Kurasiński (10% -draft, revisions). · DOI

Cited by

Sorted by citations

Authors
Korzynski, P., Mazurek, G., Krzypkowska, P., & Kurasinski, A.
Affiliations
Warsaw University of Technology (PL)
Venue
Entrepreneurial Business and Economics Review
Published
2023
Volume
11
Issue
3
Pages
25-37
ISSN
2353-8821 (ISSN-L)
OpenAlex
W4387495024
Cited by
235
References
34
Citations by year
2026: 70 · 2025: 112 · 2024: 49 · 2023: 4
FWCI
22.15
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Entrepreneurial Business and Economics Review (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Econstor (Econstor) (submittedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
prompt engineering, digital skills, generative AI, ChatGPT, large language models, prompting strategies, AI adoption in organizations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review