How Testing Works

Which Rules Really Require an Accredited Pentester

PCI DSS, UK Open Banking and India's Account Aggregator framework are all said to require an accredited testing firm. We checked the primary text of each.

AK&RG
Cybersecify
8 min read

Three frameworks are routinely described as requiring an accredited testing firm, and in all three the primary text says something different. PCI DSS v4.0.1 states in its own normative requirement text that the tester is not required to be a QSA or an ASV. UK Open Banking has no penetration testing accreditation gate we could locate across FCA, EBA, Open Banking Limited and OpenID Foundation material. India’s Account Aggregator Master Direction does not mention CERT-In at all. What these rules do require is a qualified tester with organizational independence, which is a different thing from a badge.

Key Findings:

  • PCI DSS v4.0.1 says it outright. The normative text pairs the independence requirement with the parenthetical that the tester is not required to be a QSA or ASV, alongside Requirements 11.3.1.3, 11.4.2, 11.4.3 and 11.4.6.
  • The one PCI accreditation gate is at 11.3.2, which covers quarterly external vulnerability scanning and does require an Approved Scanning Vendor. Scanning and penetration testing are different obligations.
  • UK Open Banking: no pentest is required at FCA authorisation. Post-authorisation, EBA/GL/2017/17 Guideline 7 asks for independent testers not involved in the development. The only CREST mention we found is a 2018 Open Banking Limited recommendation that lists OSCP in the same non-exhaustive example.
  • India’s Account Aggregator framework: the phrase CERT-In does not appear in the Master Direction. Sahamati empanels certifiers, which gates who certifies a participant, not who tests one.
  • 🔴 One counter-example that cuts the other way, and it belongs here. SEBI’s cyber resilience framework material includes an FAQ requiring CERT-In empanelled organisations for software DAST and SAST. That is a genuine Indian accreditation gate. We are not empanelled.
  • Accreditation gates cluster around who signs the paper, not around who does the testing the paper relies on.

Cybersecify is a founder-led penetration testing firm in Bengaluru. We wrote this because the same misreading costs our buyers money in three different jurisdictions, and because we are on the losing side of it: we are not CERT-In empanelled, so a buyer who believes empanelment is universally mandatory does not call us. That is a reason to be careful with this page rather than a reason not to publish it, so every claim below names the document it came from.

PCI DSS: the standard answers this itself

This is the clearest of the three, because the standard does not leave it to interpretation.

PCI DSS v4.0.1 requires that penetration testing is performed by a qualified internal resource or a qualified external third party, and that organizational independence of the tester exists. The requirement text then adds, in the normative wording rather than in guidance, that the tester is not required to be a QSA or an ASV. That parenthetical appears alongside Requirements 11.3.1.3, 11.4.2, 11.4.3 and 11.4.6.

PCI DSS requirementActivityAccredited party required?
11.3.2Quarterly external vulnerability scanningYes, an ASV
11.4.2Internal penetration testing, at least every 12 monthsNo. Qualified and independent
11.4.3External penetration testing, at least every 12 monthsNo. Qualified and independent
11.4.5Segmentation control testing, at least every 12 monthsNo
11.4.6Segmentation testing for service providers, at least every 6 monthsNo
Report on ComplianceAssessment and sign-offYes, a QSA

Read the table as a shape rather than as six facts. Accreditation attaches to the scan and to the sign-off. It does not attach to the penetration test in between. Vendors who hold ASV or QSA status have an honest reason to mention it and a commercial reason to let you generalise from it.

Two of our own pages cover the underlying tests in depth: what an internal network penetration test is and what an external network penetration test is. Both name the PCI requirement each satisfies.

UK Open Banking: an independence condition, not a badge

A UK payments buyer is frequently told that CREST accreditation is required. We looked for the rule that says so and did not find one.

At authorisation, the FCA process for Account Information Service Providers and Payment Initiation Service Providers does not require a penetration test.

Post-authorisation, the relevant instrument is the European Banking Authority’s Guidelines on security measures for operational and security risks under PSD2, EBA/GL/2017/17. Guideline 7 asks for testing by independent testers who were not involved in the development of the systems being tested. That is a condition about the relationship between tester and system, not about a certification the testing firm holds.

The single CREST reference we located across the FCA, Open Banking Limited, EBA and OpenID Foundation material is a 2018 Open Banking Limited recommendation, and it lists OSCP alongside CREST in a non-exhaustive example of relevant qualifications. That detail is load-bearing: a body imposing a firm-level accreditation gate does not put an individual practitioner certification in the same list.

Note also what the Open Banking conformance suite is and is not. Functional and security profile conformance testing against FAPI is a conformance test of an implementation. It is not a penetration test and does not substitute for one.

India’s Account Aggregator framework: two empanelments, one firm

An Indian fintech entering the Account Aggregator ecosystem is often told it needs a CERT-In empanelled auditor.

The phrase CERT-In does not appear in the RBI Master Direction governing Account Aggregators, and we did not find it in the Sahamati material we reviewed. What does exist is Sahamati’s own empanelment of certifiers, which governs who may certify a participant as ready to join the ecosystem. That is a different function from running a penetration test for that participant.

The probable origin of the confusion is worth stating because it is checkable. At least one firm, AQM Technologies, appears on both lists: as a CERT-In empanelled auditor and as a Sahamati empanelled certifier. Two unrelated empanelments held by one firm read, at a glance, like one requirement.

One correction to a premise we started with, recorded because it changes who this section applies to: a Financial Information User in this framework must be registered with and regulated by a financial sector regulator. An unregulated SaaS company cannot be an FIU. Anyone sizing an Account Aggregator compliance obligation for an unregulated SaaS product has the wrong denominator.

🔴 The counter-example: SEBI

A page arguing that accreditation gates are usually myths has an obligation to publish the case that runs the other way.

SEBI’s Cybersecurity and Cyber Resilience Framework material includes an FAQ stating that software DAST and SAST should be carried out by CERT-In empanelled organisations. That is a real accreditation gate, in a real Indian regulation, applying to a real category of entity. We are not CERT-In empanelled, so for a SEBI regulated entity with that obligation, we are not the vendor.

We also have not read the VAPT auditor eligibility annexure of the same framework. Our knowledge of SEBI’s full position is therefore incomplete, and saying so is more useful to you than a clean answer we cannot support.

Government engagements and Critical Information Infrastructure work commonly carry empanelment requirements for the same reason. The honest summary is not that empanelment never binds. It is that it binds in named categories, and most private-sector SaaS buyers are not in one of them. Our two existing pages on this split it precisely: who needs a CERT-In empanelled pentest vendor and when you do not.

How to check a claimed requirement in under an hour

  1. Get the document name and version. PCI DSS v4.0.1. EBA/GL/2017/17. The specific RBI Master Direction. A requirement that cannot be named to that level is a retelling, not a rule.
  2. Find the normative requirement text, not guidance and not a vendor summary. Guidance routinely softens or hardens what the requirement says.
  3. Search that text for the accreditation term: QSA, ASV, CREST, empanelled.
  4. Check whether the hit sits in a requirement or in an example. In our reading, terms that survive this step attach to scanning and to certificate issuance far more often than to penetration testing.

What genuinely cannot be substituted

To be clear about where accreditation is structural rather than optional:

OutputWho must issue it
ISO 27001 certificateAn accredited certification body
SOC 2 reportAn independent licensed CPA firm
PCI DSS Report on ComplianceA Qualified Security Assessor
PCI DSS quarterly external scanAn Approved Scanning Vendor
Penetration test reportA qualified, independent tester

The bottom row is the one this page is about, and it is the only row where the requirement is a condition rather than a credential.

We prepare and evidence against ISO 27001 and SOC 2; we do not issue either, and the pricing page says which plan carries which mapping. You can read the sample report in full before any conversation, which is the check that actually predicts whether a report survives review.

Where to go from here

Corrections and updates

We publish corrections rather than editing them away, so a reader who acted on an earlier version can see what changed. Some entries record a change in the source document itself, others record our own error. Dates are our review dates, not the source's change date.

Every claim on this page is sourced to a named document, and two of them are explicitly incomplete: we have not read SEBI’s VAPT auditor eligibility annexure, and our Account Aggregator finding is an absence of a term in the documents we reviewed rather than a statement about every Indian rule. If you can point to text that contradicts anything here, tell us and we will correct it and say what changed. Our corrections policy explains how.

Frequently Asked Questions

Does PCI DSS require a QSA to perform the penetration test?

No. PCI DSS v4.0.1 states the requirement in its own normative text, and the parenthetical is explicit: organizational independence of the tester exists, and the tester is not required to be a QSA or an ASV. The requirement is that testing is performed by a qualified internal resource or a qualified external third party, with organizational independence from the systems being tested. That parenthetical appears alongside Requirements 11.3.1.3, 11.4.2, 11.4.3 and 11.4.6. The one place the standard does mandate a specific accredited party is Requirement 11.3.2, which covers quarterly external vulnerability scanning and does require an Approved Scanning Vendor. So the accreditation requirement is real and it attaches to scanning, not to penetration testing, and conflating the two is the single most common error we see in vendor marketing.

Does UK Open Banking require a CREST-accredited testing firm?

No rule we could find in the primary text says so. The FCA authorisation process for AISP and PISP firms does not require a penetration test at authorisation. Post-authorisation, the EBA Guidelines on security measures for operational and security risks under PSD2, reference EBA/GL/2017/17, ask at Guideline 7 for testing by independent testers who were not involved in the development of what they are testing. That is an independence condition, not an accreditation gate. The single CREST mention we located across the FCA, Open Banking Limited, EBA and OpenID Foundation material is a 2018 Open Banking Limited recommendation that lists OSCP alongside CREST in a non-exhaustive example, and a body imposing a firm-level accreditation gate does not put an individual practitioner certification in the same list.

Does India's Account Aggregator framework require a CERT-In empanelled auditor?

The phrase CERT-In does not appear in the RBI Master Direction governing Account Aggregators, and we did not find it in the Sahamati material we reviewed either. The empanelment that does apply in that ecosystem is Sahamati's own empanelment of certifiers, which gates who may certify a participant, not which firm may run a penetration test for that participant. The likely origin of the confusion is that at least one firm, AQM Technologies, appears on both lists: as a CERT-In empanelled auditor and as a Sahamati empanelled certifier. Two unrelated empanelments held by one firm read, at a glance, like one requirement. Verify against the Master Direction and the Sahamati certifier list rather than against a vendor's page.

Is there any Indian rule that genuinely requires a CERT-In empanelled firm?

Yes, and this is the part that cuts against the pattern, so it belongs on the same page. SEBI's Cybersecurity and Cyber Resilience Framework material includes an FAQ stating that software DAST and SAST should be carried out by CERT-In empanelled organisations. That is a real accreditation gate in a real Indian regulation and we are not empanelled. Separately, the VAPT auditor eligibility annexure of the same framework is something we have not read, so our knowledge of SEBI's full position is incomplete and we are saying so rather than implying a clean answer. Government and Critical Information Infrastructure engagements also commonly carry empanelment requirements. If your regulator names empanelment, that requirement is real and you should meet it.

Why does the same myth appear in three different jurisdictions?

Because the myth is commercially useful to whoever holds the accreditation, and because the real requirement in each case is a qualification-and-independence condition that is harder to summarise than a badge. PCI DSS asks for a qualified tester with organizational independence. The EBA guidelines ask for independent testers not involved in the development. RBI's IT framework asks for appropriately trained and independent information security experts or auditors. None of those compresses into a single logo, so a badge gets substituted for the condition in the retelling. The practical cost to a buyer is a narrowed vendor list and a higher price for the same work, justified by a requirement that the standard's own text does not contain.

How do I check a claimed accreditation requirement myself?

Four steps, and they take under an hour. First, get the name and version of the actual document: PCI DSS v4.0.1, EBA/GL/2017/17, the specific RBI Master Direction, the SEBI framework annexure. A requirement that cannot be named to that level is usually a retelling. Second, find the normative requirement text rather than guidance or a vendor summary, because guidance frequently softens or hardens what the requirement says. Third, search that text for the accreditation term itself: QSA, ASV, CREST, empanelled. Fourth, check whether the hit sits in a requirement or in an example. In our reading, the accreditation terms that survive step four attach to scanning and to certification issuance far more often than to penetration testing.

What does organizational independence actually mean in practice?

It means the person testing is not the person who built or runs the system under test. PCI DSS v4.0.1 permits a qualified internal resource, which surprises buyers who assume an external firm is mandatory, but it pairs that with an organizational independence condition that most in-house teams fail on. A security engineer testing an application their own team wrote and operates is not independent of it, regardless of how skilled they are. An internal team in a separate reporting line, with no build or operate responsibility for the target, can satisfy it. The EBA formulation is narrower and more specific: testers not involved in the development of what they are testing.

Are you CERT-In empanelled?

No, and we do not claim to be. CERT-In empanelment is a panel maintained by the Indian Computer Emergency Response Team, and it binds in specific regulated categories rather than universally. It has no relationship to SOC 2, which is an AICPA attestation standard, and none to PCI DSS penetration testing under Requirement 11.4. If your regulator, your enterprise customer or your contract names CERT-In empanelment, that is a real requirement, you should meet it, and we will tell you so at scoping rather than after you have paid. What we deliver is the testing and the evidence: reports mapped to the frameworks your auditor works from, and a retest that closes findings.

Which accreditations genuinely cannot be substituted?

The ones attached to issuing a certificate or an attestation, rather than to performing a test. An ISO 27001 certificate is issued by an accredited certification body. A SOC 2 report is issued by an independent licensed CPA firm. PCI DSS quarterly external scanning requires an Approved Scanning Vendor, and a Report on Compliance requires a Qualified Security Assessor. Those are structural and no amount of technical capability substitutes for them. The pattern is consistent and worth internalising: accreditation gates cluster around who may sign the paper, not around who may do the testing that the paper relies on.

What should we ask a vendor who says an accreditation is mandatory?

Ask them to name the document, the version and the clause. Then read that clause. A vendor who holds an accreditation has a legitimate commercial interest in your believing it is mandatory, which does not make them dishonest but does mean the claim deserves the same verification as any other sales claim. Three follow-ups are useful. Does the clause name the accreditation, or name a qualification and an independence condition? Does it apply to penetration testing, or to scanning, or to issuing a certificate? And does it apply to your entity category, since most of these obligations attach to regulated entities rather than to every company in a sector.

Does this mean accreditation is worthless?

No. An accreditation is evidence about a firm, and evidence is useful. The argument here is narrower: an accreditation is not a legal requirement unless a rule says it is, and in penetration testing the rules usually specify a qualification and an independence condition instead. Treat accreditation as one signal among several rather than as a filter that removes everyone else from consideration. The signals that correlate with a usable report, in our experience of what auditors and enterprise reviewers actually push back on, are a named lead tester with a verifiable credential, a named methodology at a released version, a sanitised sample report you can read before buying, and a retest included rather than quoted afterwards.

How should an Indian SaaS company approach this in practice?

Separate the three buckets before you shop. Bucket one is what your regulator requires, which is where a genuine empanelment or accreditation gate lives if you have one, and SEBI regulated entities should assume they do. Bucket two is what your customers and auditors require, which is usually a qualified independent tester and a report they can read, with no accreditation named. Bucket three is what your investors ask in diligence, which is usually evidence that testing happens on a cadence. Most Indian SaaS companies selling to private enterprises sit entirely in buckets two and three, and buy against a bucket-one requirement they do not have because a vendor told them it was standard.

Security questions, worries, or not sure what to use?

Cybersecify is a founder-led penetration testing firm for AI and SaaS startups. Tell us what you are weighing and we will give you a straight answer. Ask the team or book a free 30-minute call.

Share this article
PCI DSSCERT-InAccount AggregatorOpen Bankingcompliancepenetration testingSEBI

Spotted something wrong on this page? Facts change and we get things wrong. Tell us and we will check it. We publish corrections on the page rather than editing quietly.