All articles

Shopify app security / Evidence guide

Shopify App VAPT Retesting: What Evidence Should You Keep?

Keep retest evidence that shows which original finding was checked, against which deployed version, under what test conditions and with what outcome. Separate developer remediation progress from independent verification. A successful retest of selected findings does not establish that the whole app is vulnerability-free, reconstruct the incident or guarantee Shopify relisting.

By Scantra SecurityUpdated 5 min read

Define retesting before fixes are handed over

Agree which findings will be retested and what constitutes an adequate verification opportunity. Identify the application environments, test stores, accounts, roles and required dependencies. Include access constraints and the activities that are not permitted. Retesting is easier to interpret when its scope is established before the tester receives an informal message saying everything is fixed.

Clarify whether testing will reproduce the original issue only, examine closely related bypasses or include broader regression work. Those are different levels of coverage. Confirm commercial terms, scheduling dependencies and the format of the retest output in the engagement. Do not infer an unlimited number of rounds or a fixed turnaround from a general service description. The actual agreement should make included work and limitations explicit.

Build a finding-to-fix handoff

For each finding, provide the original reference, affected component, developer action and deployment evidence. Describe what changed and why it addresses the condition identified by the assessor. Avoid sending only a commit link without explaining which environment contains the change. A patch in a development branch is not evidence that the deployed app being reviewed now has the same protection.

Record the relevant release identifier, deployment time and any configuration changes. Some fixes depend on permissions, feature flags or token rotation rather than code alone. Identify those dependencies so the tester can assess the real state. Keep original report references stable across the handoff. Renaming findings without a mapping makes it harder to connect the remediation record to the submitted VAPT report.

Reproduce the condition safely

Use authorized test accounts and stores to examine the original failure condition without accessing another merchant’s live records. For an authorization issue, verification may involve both an allowed action by the correct role and a rejected action across a prohibited boundary. Testing only that the page loads does not establish that the underlying access control works.

Record the tested route, role, environment and result with enough evidence to support the conclusion. Explain any differences from the original assessment, such as an unavailable endpoint or changed workflow. Avoid collecting more sensitive information than necessary to demonstrate the control. Testing your application does not grant permission to attack Shopify or unrelated third-party infrastructure; keep target ownership and authorization clear.

Use statuses that describe the evidence

Define the status vocabulary in the report. “Verified fixed” should mean the agreed retest condition was checked with evidence supporting closure. “Partially fixed” should explain which part remains exploitable or unverified. “Open” identifies a condition that still needs remediation, while “not retested” records that verification was not completed. The exact labels can vary, but the underlying meanings should be unambiguous.

Do not mark a finding closed solely because a developer says the patch is deployed. Equally, do not treat an access problem as proof that the issue persists: a finding may simply be unverified. Record the reason and the next dependency. Where residual risk is accepted by the app owner, distinguish that decision from technical closure. A reviewer needs to see the actual test outcome, not a status chosen to make the summary look complete.

Retain evidence and explain regression limits

Keep the original finding, remediation handoff and retest result together through stable references. Document the date, environment, release and tested conditions. Use redacted screenshots or request summaries in working reports and protect originals under the engagement’s handling arrangements. A clean screenshot without the relevant context can be misleading when several environments or app versions exist.

State the extent of regression testing. A fix to one API route may leave equivalent routes unchanged, and a merchant-boundary issue can reappear in another workflow. Discuss appropriate sibling paths with the assessor, but do not claim broad coverage unless it was performed. Retesting selected findings is not the same as a new full penetration test. A later release can also introduce new behavior outside the earlier assessment window.

Connect retest results to the governance response

Prepare a summary mapping each requested finding to the original report reference, remediation status and retest evidence. Explain outstanding work and limitations directly. Keep the submission consistent with the actual reports, rather than replacing an unresolved finding with a reassuring sentence in the cover note. Include report versions so the reviewer can tell which documents are current.

Scantra can discuss independent retesting and documentation for a scoped Shopify app assessment. Share the original findings, relevant fix details and the request in your notice before dates or deliverables are agreed. Retest evidence supports a technical response, but Shopify retains the final governance and relisting decision. It does not replace any separately requested Incident Report or establish that all historical incident effects have been resolved.

Your working checklist

  • Agree retest scope and terms in writing.
  • Map each finding to its remediation action.
  • Confirm the deployed version and configuration.
  • Use authorized accounts and test stores.
  • Distinguish fixed, partial, open and unverified.
  • Retain original findings and retest history.
  • State regression coverage and limitations.
  • Map evidence to the governance request.

Sources and limits

Platform facts are grounded in the sources below. The working examples and checklists are Scantra’s guidance, not official Shopify templates or universal requirements. No private client reports are reproduced. Follow your own notice and current platform documentation; this is not legal advice or an approval guarantee.

What our clients say

In their own words, working with Scantra.

“Scantra Security brought a methodical, thoughtful approach to our security review. Communication stayed clear throughout, and the final recommendations were practical and easy for our team to prioritize.”
Unifocus logo

Rashmiranjan

Unifocus

“The engagement felt collaborative from kickoff through delivery. Scantra’s team explained its observations clearly, answered our questions promptly, and gave us actionable guidance to help strengthen our security practices.”
Adonai Technowares logo

Rejji

Adonai Technowares

“We valued the professionalism and structure Scantra Security brought to the assessment. The team balanced technical depth with clear explanations, making the results useful to both technical stakeholders and decision-makers.”
Clarity Benefit Solutions logo

Ramya

Clarity Benefit Solutions

“Scantra Security gave us a clear view of areas that deserved attention. Its organized process, responsive communication, and focused recommendations made it easier to translate the assessment into next steps.”
Finmark logo

Arin

Finmark

“The team was thorough, approachable, and thoughtful in how it presented the findings. We appreciated that the recommendations were tied to practical risk reduction rather than simply a list of technical observations.”
Ahuda logo

Raja

Ahuda

“Working with Scantra Security was straightforward and well coordinated. The team kept us informed, addressed questions without delay, and delivered a report our team could use to plan remediation.”
LWYD Interactive logo

Harsha

LWYD Interactive

“What stood out was the depth of the review and the care taken to explain why each issue mattered. Scantra’s team stayed engaged throughout and helped us understand the priorities clearly.”
Pixuate logo

Nikhil

Pixuate

“Scantra Security combined technical rigor with a professional, easy-to-work-with approach. The findings were communicated in plain language, helping us discuss improvements with the right people across the team.”
Dental Reach logo

Rockson Samuel

Dental Reach

“The engagement was structured and supportive from start to finish. Scantra Security provided clear feedback, stayed available for follow-up discussions, and helped us approach remediation in a more organized way.”
BSS Bhopal School logo

BSS Bhopal IT Team

BSS Bhopal School

“Scantra Security took time to understand our priorities and kept the assessment focused. We appreciated the timely updates, detailed explanations, and practical direction provided at the end.”
House of Agents logo

Anmol

House of Agents

“The team demonstrated a disciplined testing process and communicated its observations with clarity. The organized reporting made it easier to review the results and align on corrective actions.”
IIT Kanpur logo

Sandeep

IIT Kanpur

“The quality of the assessment and the clarity of the final report stood out. Scantra Security was responsive to our questions and gave us useful context for addressing the identified risks.”
Webstrail logo

Nagraj

Webstrail

“Scantra Security approached the work with care and professionalism. We particularly valued the constructive discussions around findings and the clear guidance on how to approach remediation.”
BridgetIT logo

Faisal

BridgetIT

“This was a productive engagement with a team that was both thorough and responsive. The explanations were easy to follow, and the recommendations gave us a more confident basis for improving our security posture.”
Ahuda logo

Raj

Ahuda

“Scantra Security made a complex subject easier to act on. The team explained the significance of its findings clearly and provided a report that helped us focus attention where it would matter most.”
ToothTeller logo

Sharendar

ToothTeller

“We appreciated the combination of technical diligence and smooth project coordination. Scantra’s team was approachable throughout and delivered insights that were clear, specific, and useful.”
Hanomi India logo

Drishti

Hanomi India

“Scantra Security’s assessment was detailed without making the process difficult to follow. The team communicated professionally, responded quickly, and provided recommendations we could use to guide security improvements.”
BENEFLEX INDIA logo

Reema

BENEFLEX INDIA

“The engagement reflected strong technical attention and thoughtful communication. Scantra Security walked us through the findings in a clear, collaborative manner and helped us understand the best next steps.”
COCOSLABS INNOVATIVE SOLUTIONS logo

Prathvi Palekar

COCOSLABS INNOVATIVE SOLUTIONS

“Scantra Security was easy to coordinate with and thorough in its work. The final findings were well organized, and the team was available to clarify details so we could plan follow-up work effectively.”
Juego Studios logo

Suman

Juego Studios

“The team brought a practical mindset to the assessment, focusing not only on identifying issues but also on explaining their implications. We appreciated the responsiveness and clarity of the remediation guidance.”
Rebel Foods logo

Sagar

Rebel Foods

“Scantra Security managed the engagement professionally and provided clear visibility from assessment through reporting. The findings were presented with useful context, supporting informed decisions about prioritization.”
Allwyn North America logo

Khalid

Allwyn North America

“The engagement was efficient, collaborative, and technically detailed. Scantra Security answered our questions thoughtfully and delivered clear recommendations that helped turn the assessment into an actionable plan.”
Nitro Commerce logo

Meet

Nitro Commerce

“We valued the transparent communication and structured workflow throughout the engagement. Scantra’s report made the observations easy to understand and helped us identify the most important areas for follow-up.”
SaaSFlex logo

Bhavin

SaaSFlex

“Scantra Security brought a careful, professional approach and kept the process moving smoothly. The team explained its findings clearly and provided concrete recommendations without unnecessary jargon.”
Fraganote logo

Sharron

Fraganote

“From coordination to final delivery, the team was responsive and organized. Scantra Security gave us a clear understanding of the assessment outcomes and a practical foundation for further strengthening our security.”
ECOMOTEL HOTEL logo

Suchit

ECOMOTEL HOTEL

“The team combined a thorough review with clear, prompt communication. We appreciated the quality of the reporting and the way Scantra Security helped us understand which actions should come first.”
Ace Turtle logo

Harshil

Ace Turtle

“Scantra Security made it easy to collaborate at each stage. The team was open to questions, precise in its explanations, and helpful in translating the findings into sensible remediation priorities.”
Ozi Technologies logo

Shirin

Ozi Technologies

“We had a positive experience with Scantra Security’s professionalism and attention to detail. The report was clear, the discussions were productive, and the recommendations offered a helpful route toward stronger security.”
Vahdam Teas logo

Nupur

Vahdam Teas

“The engagement was managed with consistency and care. Scantra Security’s team was responsive when we needed clarification, and the final deliverable gave us a clear, prioritized view of improvements to consider.”
StoreHippo logo

Kriti

StoreHippo

“Scantra Security demonstrated a disciplined approach and strong attention to detail. The team communicated outcomes clearly and provided practical observations that supported our internal review and next-step planning.”
Quilter logo

Sergiy

Quilter

“We appreciated the team’s technical depth, discretion, and collaborative approach. Findings were explained with enough context to support meaningful follow-up, and the overall engagement was well coordinated.”
Hadrian logo

Chris Power

Hadrian

“Scantra Security approached the work with professionalism and thoughtful attention to detail. The team made time to clarify its observations and provided a clear basis for discussing potential security improvements.”
BioAge Labs logo

Kristen

BioAge Labs

“The assessment was thorough, with a reporting style that made the results easy to navigate. Scantra Security stayed responsive throughout and helped us connect technical findings to practical next steps.”
DUST Identity logo

Ophir

DUST Identity

“We valued how accessible and organized the team was throughout the engagement. Scantra Security communicated its findings clearly and gave us recommendations that were straightforward to review and act on.”
Pika logo

Demi

Pika

“Scantra Security brought a calm, methodical approach to the review. The team was collaborative, answered questions promptly, and helped us understand how to turn the findings into meaningful improvements.”
Blossom logo

Kartik

Blossom

“The team delivered a professional and well-structured engagement. Clear explanations, thoughtful follow-up, and practical reporting made the results easier to share internally and use for planning.”
Avoca logo

Tyson

Avoca

“Scantra Security was thorough without losing sight of our timelines and priorities. The team’s communication was timely, and the final report made it easier to align on remediation work.”
Sprinter Health logo

Max

Sprinter Health

“We appreciated the careful analysis and candid, constructive communication from Scantra Security. The findings were presented clearly, with enough context to help our team make informed decisions about what to address.”
NewLimit logo

Brian

NewLimit

“The engagement was smooth from kickoff to closeout. Scantra’s team was responsive and detail-oriented, and the final recommendations gave us a practical framework for continued improvement.”
HighTouch.io logo

Tejas

HighTouch.io

“Scantra Security delivered a thoughtful assessment and a clear explanation of the outcomes. The collaborative approach made follow-up discussions productive and helped us plan security work with greater clarity.”
World Labs logo

Justin

World Labs