Validated Learning Quarter

Validated Learning Quarter (hereinafter, the Quarter) is the first of four lectures of Operations Quadrivium (hereinafter, the Quadrivium):

• The Quarter is designed to introduce its learners to enterprise discovery, or, in other words, to concepts related to obtaining data needed to administer the enterprise effort; and
• The Quadrivium examines concepts of administering various types of enterprises known as enterprise administration as a whole.

The Quadrivium is the first of seven modules of Septem Artes Administrativi, which is a course designed to introduce its learners to general concepts in business administration, management, and organizational behavior.

Outline

The predecessor lecture is Resource Planning Quarter.

Concepts

1. Validated learning. The acquisition of knowledge through experience generated by trying out an idea and then measuring it against potential consumers to validate the effect. Each test of an idea is a single iteration in a larger process of many iterations whereby something is learnt and then applied to succeeding tests.
2. Learning. Any relatively permanent change in behavior that occurs as a result of experience.
   • Lessons learned. The learning gained from the process of performing the project. Lessons learned may be identified at any point.
   • Lessons learned process. A process improvement technique used to learn about and improve on a process or project. A lessons learned session involves a special meeting in which the team explores what worked, what didn't work, what could be learned from the just-completed iteration, and how to adapt processes and techniques before continuing or starting anew.
3. Ad hoc query. The ability to create a one-off, "on demand" report from BI or data analytics software that answers a specific business question.
4. Experiment.
5. Pilot project.
6. Testing. Taking measures to check the performance or reliability of something, especially before putting it into widespread use or practice, or somebody, especially before hiring. Someone who or something that conducts testing is called a tester. Someone who or something that is tested is called a testee. The testing that utilizes one or more artifacts such as a prototype or product is called artifact testing. The testing that utilizes no artifact is called natural testing.

   Testing		Tester
   		Human being	Machine
   Testee	Human being	Natural testing: observation, oral examination, oral voting; Artifact testing: questionnaire survey, ballot voting
   	Machine

7. Elicitation. Evoking or drawing out data from someone in reaction to one's own actions or questions. As an enterprise effort, elicitation most commonly consists of two phases: (a) to identify data sources and (2) to use elicitation techniques (e.g., facilitated workshops, interviews, observations, prototype testing, etc.) to gather data from those sources.
   • Intelligence elicitation. Elicitation of intelligence information from people as opposed to technical intelligence gathering disciplines such as signals intelligence, imagery intelligence, measurement and signature intelligence.
   • Expert elicitation. The synthesis of opinions of subject matter experts on a subject where there is uncertainty due to insufficient data.
8. Concept artifact.
   • Wireframe. A sketchy representation of a prototype. Wireframes are commonly developed in order to arrange elements of a future system. For instance, a wireframe can serve as a rough guide for the layout of a website or app, either done with pen and paper or with wireframing software.
   • Mockup. A model of a design for a product developed or to be developed. Mockups are commonly used to test graphic designs. If a mockup possesses any degree of functionality, it is is considered to be a prototype.
9. Prototype. A partial or preliminary conceptual model of a deliverable developed or to be developed; this model is used as a reference, publicity artifact, or data-gathering tool. A prototype allows measuring if an product idea attracts interest.
   • Low-fidelity prototype. A quick and easy translation of high-level design concepts into tangible and testable artefacts, giving an indication of the direction that the product is heading.
   • Paper prototype. A rough, often hand-sketched, drawing of a user interface, used in a usability test to gather feedback. Participants point to locations on the page that they would click, and screens are manually presented to the user based on the interactions they indicate.
   • Paper prototype. A type of usability testing where a user performs realistic tasks by interacting with a manual, early-stage version of the interface that is often manipulated by an individual who is upholding the illusion of computer interactivity. During this process, the details of how the interface is supposed to be used are withheld from the user.
   • Throw-away prototype. A prototype used to quickly uncover and clarify interface requirements using simple tools, sometimes just paper and pencil. Usually discarded when the final system has been developed.
   • Exploratory prototype. A prototype developed to explore or verify requirements.
   • Evolutionary prototype. A prototype that is continuously modified and updated in response to feedback from users.
   • Horizontal prototype. A prototype that shows a shallow, and possibly wide, view of the system's functionality, but which does not generally support any actual use or interaction.
   • Vertical prototype. A prototype that dives into the details of the interface, functionality, or both.
   • High-fidelity prototype. A prototype which is quite close to the final product, with lots of detail and a good indication of the final proposed aesthetics and functionality.
10. Minimum viable product (MVP). A version of a new product that includes sufficient features to satisfy early adopters and allows a team to collect the maximum amount of validated learning about customers with the least effort.
    • Wizard of Oz minimum viable product (WoOMVP). A version of a product that looks functional, but it actually operated by a human behind the scenes, granting the appearance of automation.
    • Concierge minimum viable product (CMVP). A manual service simulating the same exact steps people would go through with a final product.
    • Piecemeal minimum viable product (PMVP). A functioning model of a product that takes advantage of existing tools and services in order to emulate the user experience process.
11. Change control.

Roles

1. Change control board (CCB). A formally constituted group of stakeholders who is able to change requirement baselines or, in other words, to make decisions regarding the disposition and treatment of changing requirements. The most common decisions are approve or reject.
2. Tester. A stakeholder responsible for assessing the quality of, and identifying defects in, a software application.
3. User. A stakeholder, person, device, or system that directly or indirectly accesses a system.
   • End user. A person or system that directly interacts with the solution. End users can be humans who interface with the system, or systems that send or receive data files to or from the system.
4. Actor(s). The human and nonhuman roles that interact with the system.
   • Secondary actor. An actor who participates in, but does not initiate a use case.

Methods

1. Elicitation technique. Any technique of data gathering

, documentation studies

An elicitation technique is any of a number of data collection techniques used in anthropology, cognitive science, counseling, education, knowledge engineering, linguistics, management, philosophy, psychology, or other fields to gather knowledge or information from people. Elicitation, in which knowledge is sought directly from human beings, is usually distinguished from indirect methods such as gathering information from written sources.[1]

A person who interacts with human subjects in order to elicit information from them may be called an elicitor, an analyst, experimenter, or knowledge engineer, depending on the field of study.[1]

Elicitation techniques include interviews, observation of either naturally occurring behavior (including as part of participant observation) or behavior in a laboratory setting, or the analysis of assigned tasks.[1] List of elicitation techniques

   Interviews
   Brain Storming
   Focus Groups
   Exploratory Prototypes
   User Task Analysis
   Observation
   Surveys
   Questionnaire

1. Artifact testing. The data-gathering technique that is based on taking measures to check the performance and/or reliability of somebody, especially before making agreements, or something, especially before putting it into widespread use or practice.
   • Black box test. A test written without regard to how the software is implemented. These tests show only what the expected input and outputs will be.
   • User acceptance test. Test cases that users employ to judge whether the delivered system is acceptable. Each acceptance test describes a set of system inputs and expected results.
   • Acceptance test. The derivative from the acceptance criteria that verifies whether a feature is functional. The test has only two results: pass or fail. Acceptance criteria usually include one or more acceptance tests.
   • Usability test. A user sits in front of your website or app and you have them perform tasks and think out loud while doing so.
   • Contextual inquiry. Interviewing users in the location that they use the website or app, in order to understand their tasks and challenges.
   • Diary study. Asking users to record their experiences and thoughts about a product or task in a journal over a set period of time.
   • Unit testing. A short program fragment written for testing and verifying a piece of code once it is completed. A piece of code either passes or fails the unit test. The unit test (or a group of tests, known as a test suite) is the first level of testing a software development product.
   • User research. Observation techniques, task analysis, and other feedback methodologies which are used to focus on understanding user behaviors, needs, and motivations.
   • Alpha test. Controlled internal testing of a pre-production model, intended to detect design flaws or functionality deficiencies.
   • Beta test. External pilot-test after Alpha testing is complete and prior to commercial production. In beta testing, the product is released to a limited number of customers for testing under normal, everyday conditions in order to detect any flaws. (see 10 Experiments To Test Your Startup Hypothesis)
2. Inspection. A formal type of peer review that utilizes a predefined and documented process, specific participant roles, and the capture of defect and process metrics. See also structured walkthrough.
   • Inspection. The data-gathering technique that is based on careful examination of something in order to either learn about its features or check whether its features confirm its specifications.
   • Inspection. Examination or measurement of work to verify whether an item or activity conforms to a specific requirement.
3. Audit. A planned and documented activity performed by qualified personnel to determine by investigation, examination, or evaluation of objective evidence the adequacy and compliance with established procedures or the applicable documents and the effectiveness of implementation.
4. Fail-fast. The process of starting work on a task or project, obtaining immediate feedback, and then determining whether to continue working on that task or take a different approach—that is, adapt. If a project is not working, it is best to determine that early on in the process rather than waiting until too much money and time has invested.
5. Trial and error. A problem solving technique, which represents repeated, varied attempts to solve a problem continued until either success or stopping trying.
6. Dogfooding. A company showing confidence in their own product by using it themselves. Derived from the expression “eating your own dog food.”

Instruments

1. Prototyping tool.
   • Axure. A wireframing and interactive prototyping tool, available for both Windows and Mac.
   • Balsamiq Mockups. A wireframing and interactive prototyping tool, available for both Windows and Mac.
2. Sandbox. An environment or location where experimentation is acceptable, without consequences for failure.

Results

1. Findings register.

Practices

The successor lecture is Business Analysis Quarter.