Promptsmith

Questions

What people ask before signing up, and just after. Every answer here describes what the application actually does.

What does an evaluation actually look at?

Eight dimensions: structure, constraint design, input handling, the output contract, scale coherence, examples and verification, failure-mode coverage, and efficiency. Each is scored from 1 to 10 and quoted back with the line of your prompt that earned the mark.

How long does it take?

About a minute. You can close the page while it runs. The evaluation carries on without you, and the link you were given keeps working.

What does an evaluation cost?

One credit. Your first three are free, and after that credits come with a plan or as a top-up. Nothing else in the product spends them: saving prompts, opening old results and sharing links are all free.

What if an evaluation fails?

The credit comes back on its own. That includes the awkward case where the server restarts halfway through: anything left half-finished is failed and refunded when it starts again, and the page tells you so.

Who can see my prompts?

You. An administrator can read your finished reviews, because supporting an account means being able to see what it produced. Your saved drafts and your submissions are closed to them unless they open a recorded investigation into your account. That investigation expires by itself, and you are told about it afterwards, on your own account page.

Can I show somebody an evaluation?

Yes. Make a share link and anyone holding it can read that one review without signing in. It shows your prompt as well as its score, so share it only where you would share the prompt itself. You can revoke the link at any time.

If I edit a saved prompt, do its old evaluations change?

No. An evaluation stores the exact text it scored, so your history stays honest. Editing a saved prompt changes what the next evaluation sees and nothing that has already happened.

How do I tell whether a rewrite is better?

Revise an evaluation rather than starting a new one. The rewrite is scored against the same rubric and linked to the draft it replaced, so you can watch a single dimension move instead of guessing at two numbers.

Can I delete an evaluation?

It goes to your trash first, where you can restore it. Emptying the trash removes it for good, and a deleted account takes everything it owned with it.

What happens to instructions inside my prompt?

Nothing. Your prompt is passed to the model as inert data between markers, and anything in it that looks like an instruction is reported in the evaluation rather than followed. That is what the structural-risks section of a report is for.

Looking for how to do something?

The help page walks through an evaluation, the levels, and what to do with the report.

Read the help