Chapter 4 of 14intermediate pathTips 24–33

Know when a workflow becomes a Skill

Do the real work, draft the Skill while the context is fresh, test it on new examples, and automate carefully

Outcome

Start with a real piece of work. Give ChatGPT the context, trusted sources, and example you would give a teammate. Work through the task and correct what matters. Draft the Skill while the example and your corrections are still fresh. Test that draft on new examples before calling it reliable.

Automation comes later. Before anything runs on its own, you should know which sources it can use, what a good result looks like, when it needs to stop, and what still needs your approval. The goal is more help with the work, not less control over it.

Keep the layers distinct: the model provides general capability, foundational guidance supports common artifact types, approved tools provide available access, and a personal or approved shared Skill adds the method for a real workstream. Teams may distribute shared Skills through plugins only when that capability is available and approved. Writing or running a Skill does not retrain the model.

From one risk report to a reusable method
  1. Do the real report

    Use the three approved sources and last week’s example.

  2. Correct it together

    Explain the dates, risk descriptions, and judgment that matter.

  3. Draft the Skill

    Capture the method while the corrections are fresh.

  4. Test a fresh report

    Check changed risks and new evidence.

  5. Improve and reuse

    Fix what fails, then test again.

Consider a scheduled source scan only after fresh examples work. Sending and risk decisions remain with a person.

When to use it

Begin with the actual task when the problem is new or the result is still unclear. Work through a real example before asking ChatGPT to describe the whole process.

Draft a Skill when you have just seen which sources, instructions, corrections, and checks should carry into the next example. Do it while that work is still available in context. Review OpenAI's current Skills documentation before packaging one.

Treat the first version as a draft. Test it on fresh examples before relying on it or adding automation. Automate only when the starting conditions are clear, permissions are narrow, failures can be detected, and the next step can be reviewed.

Keep high-ambiguity, high-consequence decisions human-led even if parts of their preparation are repeatable.

Operating pattern

Use the right order:

  1. Choose recurring work: pick an actual job worth doing again.
  2. Share the context: provide the source, audience, example, and approval boundaries.
  3. Work through a real example: do the actual task with ChatGPT.
  4. Correct what matters: explain the source checks, judgment, and quality you want.
  5. Draft the Skill here: capture the method while the real work and corrections are still in context.
  6. Test on fresh examples: find out whether the draft works with new information.
  7. Improve and reuse: keep what carries over and fix what does not.

Use an actual example and your corrections to make the instructions specific. Capture them before the useful context is lost.

Test on fresh examples. One successful result is not enough to establish that the method is reliable. Check the draft on new work before adding automation.

At every stage, identify the trusted source and the person who approves the result. Preparing an action is not the same as being allowed to take it.

Version material changes. Test both the happy path and missing, stale, contradictory, unauthorized, and no-change cases. Treat a clean no-change result as success when nothing requires action.

Maintain the Skill instead of treating its first version as permanent. Review recent corrections and failures weekly; perform a deeper monthly cleanup using fresh representative examples. Retest when the workflow, source, owner, approval rule, model, or foundational guidance changes, and remove instructions that no longer add value.

Copyable implementation

markdown
# Workflow and Skill draft

Outcome: [user-visible result]
Current state: real example | Skill draft | tested Skill
Trusted sources: [original files and current information]
Real example: [the actual work you completed]
Corrections to keep: [source checks, decisions, and quality]
Details to leave out: [one-time facts, dates, and files]
Next fresh-example test: [what the draft needs to prove]
Human approval: [what still requires your decision]
Maintenance: [weekly correction review; monthly fresh-example retest]

If automation becomes useful later, also record:

markdown
What starts it:
What it is allowed to read or prepare:
How to prevent duplicate work:
Where to pick the work back up:
What should happen if a source is missing:
When a person must approve the next step:

Example

For example, a program manager needs a weekly risk summary. They show ChatGPT the three approved sources, last week's report, and the decisions the summary supports.

They work through the real report and correct the source dates, risk descriptions, and recommendations. While those examples and corrections are still in the conversation, they ask ChatGPT Work to draft a Skill. The draft records the source order, quality checks, and the need for a person to judge severity.

Next week, they test the draft on a new report. If it misses a changed risk or makes a decision it should not make, they improve the Skill and test again. Only after the method works on fresh examples should they consider scheduling a source scan. Sending the report and changing risk status remain human decisions.

Approval boundary

A documented Skill is not installed, a packaged integration is not connected, and a scheduled configuration is not necessarily active. Installation, configuration, authentication, authorization, scheduling, and activation are separate states that require their own evidence.

Do not automate sending, publishing, deployment, permission changes, financial commitments, destructive operations, or people-management decisions without explicit scoped authorization. Automation may prepare an action and assemble evidence for approval.

Use the least privilege needed. Never place secrets or live credentials in templates, examples, logs, or generated artifacts.

Validation

Before treating a Skill draft as reliable, confirm:

  • The real work, desired result, and owner are clear.
  • The draft was written while the example and corrections were still available.
  • Fresh examples produce good results without relying on the first example's facts.
  • A different example exposes missing exceptions without copying the original answer.
  • Inputs have owners and currentness rules.
  • Variations and unsupported cases are documented.
  • Validation detects materially wrong output.
  • Duplicate runs are safe or prevented.
  • Failures produce an actionable state rather than silent success.
  • Approval boundaries are enforced in behavior, not merely described.
  • A person can stop, inspect, and recover the process.
  • The review cadence and owner are recorded, with stale guidance removed.

For automation, run it in an isolated or review-only mode before enabling consequential actions.

Failure modes

Drafting a Skill without examples or verified workflow details leaves assumptions untested. Waiting until the useful conversation is gone loses the example, feedback, and reasoning that should have taught it. Calling the first draft reliable skips the fresh-example test.

Other failures include automating an untested workflow, trusting stale sources, duplicating work, and letting an agent send or change something without approval. Do not add automation because a task is boring. Add it only when the work has been tested and a person can still stop or review it.

The safest system stops when evidence, permission, or currentness is missing. Manual review is not technical debt when it contains the judgment the process cannot reliably encode.

0% of the Playbook complete on this device