What Is OSINT?#

Open Source Intelligence (OSINT) is the collection, analysis, and use of information from publicly available sources. It’s a critical skill in cybersecurity — used in penetration testing, threat intelligence, fraud investigation, incident response, and red team operations.

“Open source” here means publicly accessible — not “free software.” Sources include the internet, social media, public records, news, satellite imagery, and leaked databases.


The Intelligence Cycle#

flowchart TD
    A["1. Planning & Direction<br/>Define objectives"] --> B["2. Collection<br/>Gather raw data"]
    B --> C["3. Processing<br/>Filter, organize, normalize"]
    C --> D["4. Analysis<br/>Interpret, correlate, assess"]
    D --> E["5. Dissemination<br/>Report findings"]
    E --> F["6. Feedback<br/>Refine requirements"]
    F --> A

Planning Questions#

Before collecting anything, define:

  • What am I looking for? (target scope)
  • Why do I need it? (objective — pentest, threat intel, investigation)
  • How deep should I go? (passive recon only? active probing?)
  • What’s legal? (jurisdiction, authorization, privacy laws)

OSINT Categories#

CategorySourcesExamples
PeopleSocial media, professional profiles, public recordsLinkedIn, Facebook, voter registries, court records
InfrastructureDNS, IP records, certificates, bannersShodan, Censys, Certificate Transparency logs
OrganizationsCorporate filings, job postings, press releasesSEC filings, Glassdoor, annual reports
TechnicalCode repositories, paste sites, forumsGitHub, GitLab, Pastebin, Stack Overflow
GeospatialMaps, satellite imagery, geotagged mediaGoogle Earth, Sentinel Hub, Mapillary
Dark WebOnion sites, marketplaces, forumsTor-based sites (with appropriate authorization)
MediaNews, podcasts, YouTube, academic papersGoogle Scholar, news archives

Passive vs Active Reconnaissance#

AspectPassive OSINTActive OSINT
InteractionNo direct contact with targetDirect interaction (probing, scanning)
Detection riskZero — target can’t knowDetectable — leaves logs, fingerprints
ExamplesReading public website, DNS lookups via third partiesPort scanning, sending phishing emails, calling target
LegalityGenerally legal (public info)May require authorization (pentest scope)
ToolsShodan, Google dorking, social mediaNmap, Burp Suite, social engineering

The OSINT discipline focuses primarily on passive collection. Active probing crosses into penetration testing territory and requires explicit authorization.


Domain and Infrastructure OSINT#

DNS Enumeration#

# Basic DNS lookups
dig example.com ANY
dig example.com MX
dig example.com TXT              # SPF, DKIM, verification records

# Zone transfer attempt (usually denied, but always try)
dig @ns1.example.com example.com AXFR

# Subdomain enumeration
amass enum -d example.com
subfinder -d example.com

WHOIS#

whois example.com
# Returns: registrant, creation/expiry dates, nameservers, registrar
# Historical WHOIS: whoxy.com, domaintools.com

Certificate Transparency Logs#

Every HTTPS certificate issued is logged publicly. This reveals subdomains:

# Search CT logs for all certificates issued to a domain
curl "https://crt.sh/?q=%25.example.com&output=json" | jq '.[].name_value'

Shodan / Censys#

Search engines for internet-connected devices:

# Shodan queries
org:"Target Company"
ssl.cert.subject.CN:"example.com"
port:3389 country:ES
http.title:"Dashboard" org:"Target"

# Find exposed services
hostname:example.com port:22,3306,5432,6379,27017

Wayback Machine#

View historical versions of websites — find removed pages, old configurations, or exposed files:

https://web.archive.org/web/*/example.com

People OSINT#

Social Media Intelligence (SOCMINT)#

PlatformWhat You Can Find
LinkedInJob title, employer, skills, connections, education, publications
Twitter/XOpinions, geolocation, connections, daily routine
FacebookFriends, locations, life events, group memberships
InstagramLocations (geotagged photos), daily life, social circle
GitHubCode skills, email in commits, projects, employer
RedditInterests, writing patterns, location hints

Username OSINT#

A single username often reused across platforms:

# Tools that check username across hundreds of sites
sherlock username
whatsmyname username
namechk username

Email OSINT#

# Check if email appears in data breaches
# haveibeenpwned.com API (legitimate use)
# holehe — checks which services an email is registered on
holehe target@example.com

# Email header analysis — trace the path of a suspicious email

Google Dorking for People#

"John Smith" site:linkedin.com "Target Company"
"target@example.com" filetype:pdf
"Target Company" site:glassdoor.com

Google Dorking (Advanced Search Operators)#

Google operators are extremely powerful for finding exposed information:

OperatorPurposeExample
site:Limit to domainsite:example.com admin
filetype:Specific file typefiletype:pdf confidential
intitle:Text in page titleintitle:"index of" /backup
inurl:Text in URLinurl:admin login
intext:Text in page bodyintext:"password" filetype:log
cache:Cached version of pagecache:example.com/secret
-Exclude termsite:example.com -www
""Exact phrase"default password"
*Wildcard"admin * password"

Common Google Dorks for Security#

# Exposed sensitive files
filetype:env "DB_PASSWORD"
filetype:sql "INSERT INTO" "password"
filetype:log "password"
filetype:cfg "password"

# Exposed admin panels
intitle:"admin" inurl:login site:example.com
intitle:"phpMyAdmin" "Welcome to phpMyAdmin"

# Exposed directories
intitle:"index of" ".git"
intitle:"index of" "backup"
intitle:"index of" "wp-content/uploads"

# Exposed cameras/IoT
inurl:"view.shtml" "Network Camera"
intitle:"webcamXP" inurl:":8080"

# Exposed documents
site:example.com filetype:xlsx OR filetype:docx "confidential"
site:drive.google.com "example.com"

Tools Directory#

Frameworks#

ToolPurpose
MaltegoVisual link analysis — connects entities (people, domains, IPs)
SpiderFootAutomated OSINT collection across 200+ sources
Recon-ngModular web reconnaissance framework (like Metasploit for OSINT)
theHarvesterEmail, subdomain, IP harvesting from public sources
OSINT Frameworkosintframework.com — categorized list of tools and resources

Domain / Infrastructure#

ToolPurpose
ShodanSearch engine for internet-connected devices
CensysCertificate and host discovery
amassIn-depth subdomain enumeration
subfinderFast subdomain discovery
DNSdumpsterDNS recon and visualization
SecurityTrailsHistorical DNS and WHOIS data
BuiltWithTechnology profiling (what stack a site uses)

People / Social#

ToolPurpose
SherlockUsername search across 300+ sites
holeheCheck email registration across services
PhoneInfogaPhone number OSINT
GHuntGoogle account investigation
MaigretUsername enumeration (Sherlock alternative)

Image / Geolocation#

ToolPurpose
Google Reverse Image SearchFind where an image appears online
TinEyeReverse image search with change detection
ExifToolExtract metadata from images (GPS coords, camera, timestamp)
GeoGuessr / geointPractice geolocation from imagery
SunCalcDetermine time from shadow angles in photos

OSINT Methodology#

The Funnel Approach#

flowchart TD
    A["Wide: Domain/Organization<br/>DNS, WHOIS, corporate info"] --> B["Medium: Infrastructure<br/>Subdomains, services, technologies"]
    B --> C["Focused: People<br/>Employees, emails, roles"]
    C --> D["Deep: Specific Targets<br/>Credentials, vulnerabilities, patterns"]
    D --> E["Correlation<br/>Connect findings into attack surface map"]

Documentation#

Always document:

  • What was found
  • Where it was found (URL, tool, timestamp)
  • How it was found (search query, technique)
  • Significance (why it matters for the objective)

Use screenshots — web content can disappear.


RuleExplanation
Public ≠ ethical to exploitJust because data is accessible doesn’t mean it’s ethical to use for harm
GDPR appliesIn the EU, collecting personal data (even public) is processing under GDPR
Authorization mattersFor pentest engagements, get written scope defining what OSINT is permitted
Don’t access restricted contentBypassing access controls (even weak ones) may violate computer crime laws
Don’t impersonateCreating fake profiles to extract information crosses into social engineering
Report responsiblyIf you find exposed sensitive data, consider responsible disclosure
Document everythingMaintain a clear audit trail of what you collected and how

OSINT Ethics Framework#

  1. Is it publicly available without authentication? → Generally fair game
  2. Am I authorized to collect this for my stated purpose? → Check scope
  3. Could this cause harm to an uninvolved party? → Proceed carefully
  4. Am I complying with applicable data protection laws? → GDPR, CCPA, etc.
  5. Would I be comfortable explaining my methods? → The transparency test

Defensive OSINT (Reducing Your Attack Surface)#

Organizations should OSINT themselves regularly:

CheckAction
Google dork your own domainFind exposed files, admin panels, credentials
Monitor CT logsDetect unauthorized certificate issuance (subdomain takeover)
Audit public code reposEnsure no secrets in commit history
Check data breach databasesKnow if employee credentials are exposed
Review social mediaWhat are employees sharing about internal systems?
Monitor paste sitesLook for leaked data mentioning your organization

Key Takeaways#

  1. OSINT is passive first — gather everything you can without touching the target directly
  2. Google dorking is incredibly powerful — it’s the first tool in any OSINT investigation
  3. Certificate Transparency logs reveal subdomains you can’t find any other way
  4. Usernames are reused — one username often maps to dozens of profiles across services
  5. Document everything — screenshots, timestamps, URLs. Content disappears.
  6. Legal boundaries exist — public data still has privacy protections (GDPR). Always have authorization.
  7. Defensive OSINT is equally important — regularly search for your own organization’s exposure
  8. The intelligence cycle (plan → collect → analyze → report) prevents aimless browsing and ensures actionable output