v1.6.9

What's Changed

🎉 New Features

• Added support to filter out near duplicate responses by @dogancanbakir in #1951

   -fd, -filter-duplicates  filter out near-duplicate responses (only first response is retained)

• Added team-id input support for dashboard upload by @RamanaReddy0M in #1886

   -tid, -team-id string  upload asset results to given team id (optional)

• Added option to provide ideal time taking screenshot with -screenshot option by @michael2to3 in #1917

   -sid, -screenshot-idle value     set idle time before taking screenshot in seconds (default 1s)

• Adding -trace option to log complete connection by @Mzack9999 in #1883

httpx -u example.com -trace -j

• Added initial support for automatic page type classifier by @dogancanbakir in #1924

🐞 Bug Fixes

• Fixed issue to not store responses for failed probe by @dogancanbakir in #1954

Other Changes

• Added option to provide pdcp auth via config file by @dogancanbakir in #1912
• Used mapstructure tag by @dogancanbakir in #1898

New Contributors

• @michael2to3 made their first contribution in #1917

Full Changelog: v1.6.8...v1.6.9

v1.6.8

What's Changed

• Fixed missing favicon hash in few edge cases by @RamanaReddy0M in #1848
• Fixed ztls context deadline error for tls connection by @RamanaReddy0M in #1860
• Fixed stats calculation in case of path by @dogancanbakir in #1870
• Fixed issue with extra new lines in output file by @dogancanbakir in #1861
• Fixed multiple registration of metrics (SDK) by @dwisiswant0 in #1862
• Added option disable stdout output (SDK) by @dogancanbakir in #1871
• Added *Server.Stop method (SDK) by @dwisiswant0 in #1863
• Updated ChainInStdout option available to use as library (SDK) by @meme-lord in #1855

New Contributors

• @dwisiswant0 made their first contribution in #1862
• @meme-lord made their first contribution in #1855

Full Changelog: v1.6.7...v1.6.8

v1.6.7

What's Changed

• Added UI Dashboard for httpx by @tarunKoyalwar in #1834

   -pd, -dashboard                 upload / view output in projectdiscovery cloud (pdcp) UI dashboard
   -aid, -asset-id string          upload new assets to existing asset id (optional)
   -aname, -asset-name string      assets group name to set (optional)
   -pdu, -dashboard-upload string  upload httpx output file (jsonl) in projectdiscovery cloud (pdcp) UI dashboard

• Added -fep option to configure error file by @dogancanbakir in #1830

   -fep, -filter-error-page  filter response with ML based error page detection

• Fixed issue with missing host field in output in few edge cases by @RamanaReddy0M in #1818
• Updatedjarm field to jarm_hash to avoid confusion by @dogancanbakir in #1820

Full Changelog: v1.6.6...v1.6.7

v1.6.6

What's Changed

• Added md5 hash for favicon in jsonl output by @dogancanbakir in #1799
• Fixed issue with -fs filtering by @dogancanbakir in #1811
• Fixed issue with custom header input for screenshot by @dogancanbakir in #1785
• Fixed nil deref with store chain option by @dogancanbakir in #1788
• Fixed issue with path input by @dogancanbakir in #1790
• Fixed issue with -esb option not storing screenshot on disk by @Aituglo in #1802

New Contributors

• @Aituglo made their first contribution in #1802

Full Changelog: v1.6.5...v1.6.6

v1.6.5

What's Changed

• Added favicon_url in output with -favicon option by @Ice3man543 in #1774

# OPTION
-favicon  display mmh3 hash for '/favicon.ico' file

# EXAMPLE
$ echo hackerone.com | ./httpx -favicon -j -silent | jq -r .favicon_url
https://hackerone.com/favicon.ico

• Fixed issues with favicon detection + SDK update by @Ice3man543 in #1774
• Fixed panic issue with wappalyzer by @dogancanbakir in #1777

Full Changelog: v1.6.4...v1.6.5

v1.6.4

What's Changed

🎉 New Features

• Added -efqdn option to extract subdomans from response header and body by @RamanaReddy0M in #1733

# OPTION
-extract-fqdn, -efqdn  get domain and subdomains from response body and header in jsonl/csv output

# EXAMPLE
$ echo tesla.com | ./httpx -efqdn -j -fr  | jq .

• Added support to exclude response body with -sr option by @saeed0x1 in #1671

# OPTION
-ob, -omit-body  omit response body in output

# EXAMPLE
$ echo hackerone.com | ./httpx -store-response -omit-body

• Added support for multiple input for filter options by @dogancanbakir in #1761

🐞 Bug Fixes

• Fixed issue with empty host by @dogancanbakir in #1759
• Fixed issue with missing 1XX status code in output by @dogancanbakir in #1760

Other Changes

• Added http based speed control (SDK) by @dogancanbakir in #1762
• Ảdded support to use networkpolicy + wappalyzer singletons (SDK) by @Ice3man543 in #1769

New Contributors

• @saeed0x1 made their first contribution in #1671

Full Changelog: v1.6.3...v1.6.4

v1.6.3

What's Changed

🐞 Bug Fixes

• Fixed issue with tech detection output in default run by @dogancanbakir in #1732
• Fixed issue with -sr option to respect filters/matchers by @Mzack9999 in #1720

Full Changelog: v1.6.2...v1.6.3

v1.6.2

What's Changed

🎉 New Features

• Added resolvers information in output by @Mzack9999 in #1718

🐞 Bug Fixes

• Fixed nil deref by @dogancanbakir in #1719

Other Changes

• bump version by @dogancanbakir in #1717

Full Changelog: v1.6.1...v1.6.2

v1.6.1

What's Changed

🎉 New Features

• Added -protocol option for force http 1.1 connection by @Mzack9999 in #1669

   -pr, -protocol string  protocol to use (unknown, http11)

🐞 Bug Fixes

• Added AAAA dns type in JSONL for IPv6 by @Mzack9999 in #1668

Other Changes

• Fixed content rel issues by @dogancanbakir in #1630
• Added CanHaveTitleTag Function for MIME Type Validation by @RedYetiDev in #1608
• Updated -tech-detect flag var type by @dogancanbakir in #1702
• Updated wappalyzer-go + misc additions by @Ice3man543 in #1699

New Contributors

• @RedYetiDev made their first contribution in #1608

Full Changelog: v1.6.0...v1.6.1

v1.6.0

What's Changed

• Fixed issue with -csv format including response header/body as default by @RamanaReddy0M in #1618
• Fixed issue with -exclude option by @dogancanbakir in #1617
• Updated default JSONL output fields by @RamanaReddy0M in #1614
  • Added tech and cdn, cdn_name, can be optionally disabled (-tech-detect=false)
  • Removed hash, can be optionally enabled (-hash md5,mmh3)

{
  "timestamp": "2024-03-02T02:37:52.116518+05:30",
-  "hash": {
-    "body_md5": "84238dfc8092e5d9c0dac8ef93371a07",
-    "body_mmh3": "-1139337416",
-    "body_sha256": "ea8fac7c65fb589b0d53560f5251f74f9e9b243478dcb6b3ea79b5e36449c8d9",
-    "body_simhash": "9899951357530060719",
-    "header_md5": "1892a0082f71e142d1972cd0ad94416b",
-    "header_mmh3": "-1939422575",
-    "header_sha256": "fac11d1b8a4259066455332206523eb94ff2da43d408873e7d4246cebf855716",
-    "header_simhash": "14461785313525862383"
-  },
  "port": "443",
  "url": "https://example.com",
  "input": "example.com",
  "title": "Example Domain",
  "scheme": "https",
  "webserver": "ECS (dce/2694)",
  "content_type": "text/html",
  "method": "GET",
  "host": "93.184.216.34",
  "path": "/",
  "time": "1.248762166s",
  "a": [
    "93.184.216.34",
    "2606:2800:220:1:248:1893:25c8:1946"
  ],
+  "tech": [
+    "Amazon ECS",
+    "Amazon Web Services",
+    "Azure",
+    "Azure CDN",
+    "Docker"
+  ],
+  "cdn_name": "google",
+  "cdn": true,
  "words": 298,
  "lines": 47,
  "status_code": 200,
  "content_length": 1256,
  "failed": false,
  "knowledgebase": {
    "PageType": "nonerror",
    "pHash": 0
  }
}

Caution

Updated default JSONL output fields by @RamanaReddy0M in #1614

Full Changelog: v1.5.0...v1.6.0