| Port details on branch 2022Q2 |
- py-dns-crawler Crawler for getting info about DNS domains and services
- 1.6.3 dns
 =0      1.6.3Version of this port present on the latest quarterly branch. - Maintainer: sunpoet@FreeBSD.org
- Port Added: 2021-06-14 17:48:47
- Last Update: 2024-03-23 14:49:27
- Commit Hash: 8e0de39
- Also Listed In: python
- License: GPLv3
- WWW:
- https://gitlab.nic.cz/adam/dns-crawler
- Description:
- Despite the name, the crawler gets info for more services than just DNS:
- DNS:
- all A/AAAA records (for the 2nd level domain and www.subdomain), annotated
with GeoIP
- TXT records (with SPF and DMARC parsed for easier filtering)
- TLSA (for the 2nd level domain and www.subdomain)
- MX
- DNSSEC validation
- nameservers:
- each server IP annotated with GeoIP
- HOSTNAME.BIND, VERSION.BIND, AUTHORS.BIND and fortune (also for all IPs)
- users can add custom additional RRs in the config file
- E-mail (for every server from MX):
- SMTP server banners (optional, ports are configurable)
- TLSA records
- Web:
- HTTP status & headers (inc. parsed cookies) for ports 80 & 443 on each IP
from A/AAAA records
- certificate info for HTTPS (optionally with an entire cert chain)
- webpage content (optional)
- everything of the above is saved for each step in the redirect history --
the crawler follows redirects until it gets a non-redirecting status or hits
a configurable limit
  ¦  ¦  ¦  ¦ 
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - There is no configure plist information for this port.
- Dependency lines:
-
- ${PYTHON_PKGNAMEPREFIX}dns-crawler>0:dns/py-dns-crawler@${PY_FLAVOR}
- To install the port:
- cd /usr/ports/dns/py-dns-crawler/ && make install clean
- To add the package, run one of these commands:
- pkg install dns/py-dns-crawler
- pkg install py39-dns-crawler
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
NOTE: This is a Python port. Instead of py39-dns-crawler listed in the above command, you can pick from the names under the Packages section.- PKGNAME: py39-dns-crawler
- Package flavors (<flavor>: <package>)
- distinfo:
- TIMESTAMP = 1710712500
SHA256 (dns-crawler-1.6.3.tar.gz) = 4e794a9e7a978bdfd0f61e62144d4677c72626559632071d79623e917e57de6c
SIZE (dns-crawler-1.6.3.tar.gz) = 45095
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- py39-setuptools>=41 : devel/py-setuptools@py39
- py39-setuptools-git-versioning>=0<2 : devel/py-setuptools-git-versioning@py39
- py39-wheel>=0 : devel/py-wheel@py39
- python3.9 : lang/python39
- py39-build>=0 : devel/py-build@py39
- py39-installer>=0 : devel/py-installer@py39
- Test dependencies:
-
- python3.9 : lang/python39
- Runtime dependencies:
-
- py39-asn1crypto>=1.5.1 : devel/py-asn1crypto@py39
- py39-cert-human>=1.0.7 : security/py-cert-human@py39
- py39-checkdmarc>=4.3.1 : mail/py-checkdmarc@py39
- py39-dnspython>=2.3.0,1 : dns/py-dnspython@py39
- py39-ecdsa>=0.18.0 : security/py-ecdsa@py39
- py39-forcediphttpsadapter>=1.0.2 : www/py-forcediphttpsadapter@py39
- py39-GeoIP2>=3.0.0 : net/py-GeoIP2@py39
- py39-hstspreload>=0 : www/py-hstspreload@py39
- py39-idna>=2.10 : dns/py-idna@py39
- py39-pyaml>=21.10.1 : textproc/py-pyaml@py39
- py39-pyicu>=2.10.2 : devel/py-pyicu@py39
- py39-openssl>=23.1.1,1 : security/py-openssl@py39
- py39-python-magic>=0.4.27 : devel/py-python-magic@py39
- py39-redis>=4.5.4 : databases/py-redis@py39
- py39-requests>=2.23.0 : www/py-requests@py39
- py39-requests-toolbelt>=0.10.1 : www/py-requests-toolbelt@py39
- py39-rq>=1.13.0 : devel/py-rq@py39
- py39-cryptography>=41.0.7,1 : security/py-cryptography@py39
- python3.9 : lang/python39
- There are no ports dependent upon this port
Configuration Options:- No options to configure
- Options name:
- dns_py-dns-crawler
- USES:
- python
- FreshPorts was unable to extract/find any pkg message
- Master Sites:
|
As an Amazon Associate I earn from qualifying purchases.