Shopify app security / Evidence guide
Shopify App VAPT Retesting: What Evidence Should You Keep?
Keep retest evidence that shows which original finding was checked, against which deployed version, under what test conditions and with what outcome. Separate developer remediation progress from independent verification. A successful retest of selected findings does not establish that the whole app is vulnerability-free, reconstruct the incident or guarantee Shopify relisting.
Define retesting before fixes are handed over
Agree which findings will be retested and what constitutes an adequate verification opportunity. Identify the application environments, test stores, accounts, roles and required dependencies. Include access constraints and the activities that are not permitted. Retesting is easier to interpret when its scope is established before the tester receives an informal message saying everything is fixed.
Clarify whether testing will reproduce the original issue only, examine closely related bypasses or include broader regression work. Those are different levels of coverage. Confirm commercial terms, scheduling dependencies and the format of the retest output in the engagement. Do not infer an unlimited number of rounds or a fixed turnaround from a general service description. The actual agreement should make included work and limitations explicit.
Build a finding-to-fix handoff
For each finding, provide the original reference, affected component, developer action and deployment evidence. Describe what changed and why it addresses the condition identified by the assessor. Avoid sending only a commit link without explaining which environment contains the change. A patch in a development branch is not evidence that the deployed app being reviewed now has the same protection.
Record the relevant release identifier, deployment time and any configuration changes. Some fixes depend on permissions, feature flags or token rotation rather than code alone. Identify those dependencies so the tester can assess the real state. Keep original report references stable across the handoff. Renaming findings without a mapping makes it harder to connect the remediation record to the submitted VAPT report.
Reproduce the condition safely
Use authorized test accounts and stores to examine the original failure condition without accessing another merchant’s live records. For an authorization issue, verification may involve both an allowed action by the correct role and a rejected action across a prohibited boundary. Testing only that the page loads does not establish that the underlying access control works.
Record the tested route, role, environment and result with enough evidence to support the conclusion. Explain any differences from the original assessment, such as an unavailable endpoint or changed workflow. Avoid collecting more sensitive information than necessary to demonstrate the control. Testing your application does not grant permission to attack Shopify or unrelated third-party infrastructure; keep target ownership and authorization clear.
Use statuses that describe the evidence
Define the status vocabulary in the report. “Verified fixed” should mean the agreed retest condition was checked with evidence supporting closure. “Partially fixed” should explain which part remains exploitable or unverified. “Open” identifies a condition that still needs remediation, while “not retested” records that verification was not completed. The exact labels can vary, but the underlying meanings should be unambiguous.
Do not mark a finding closed solely because a developer says the patch is deployed. Equally, do not treat an access problem as proof that the issue persists: a finding may simply be unverified. Record the reason and the next dependency. Where residual risk is accepted by the app owner, distinguish that decision from technical closure. A reviewer needs to see the actual test outcome, not a status chosen to make the summary look complete.
Retain evidence and explain regression limits
Keep the original finding, remediation handoff and retest result together through stable references. Document the date, environment, release and tested conditions. Use redacted screenshots or request summaries in working reports and protect originals under the engagement’s handling arrangements. A clean screenshot without the relevant context can be misleading when several environments or app versions exist.
State the extent of regression testing. A fix to one API route may leave equivalent routes unchanged, and a merchant-boundary issue can reappear in another workflow. Discuss appropriate sibling paths with the assessor, but do not claim broad coverage unless it was performed. Retesting selected findings is not the same as a new full penetration test. A later release can also introduce new behavior outside the earlier assessment window.
Connect retest results to the governance response
Prepare a summary mapping each requested finding to the original report reference, remediation status and retest evidence. Explain outstanding work and limitations directly. Keep the submission consistent with the actual reports, rather than replacing an unresolved finding with a reassuring sentence in the cover note. Include report versions so the reviewer can tell which documents are current.
Scantra can discuss independent retesting and documentation for a scoped Shopify app assessment. Share the original findings, relevant fix details and the request in your notice before dates or deliverables are agreed. Retest evidence supports a technical response, but Shopify retains the final governance and relisting decision. It does not replace any separately requested Incident Report or establish that all historical incident effects have been resolved.
Your working checklist
- Agree retest scope and terms in writing.
- Map each finding to its remediation action.
- Confirm the deployed version and configuration.
- Use authorized accounts and test stores.
- Distinguish fixed, partial, open and unverified.
- Retain original findings and retest history.
- State regression coverage and limitations.
- Map evidence to the governance request.
Sources and limits
Platform facts are grounded in the sources below. The working examples and checklists are Scantra’s guidance, not official Shopify templates or universal requirements. No private client reports are reproduced. Follow your own notice and current platform documentation; this is not legal advice or an approval guarantee.







































