TODO list courtesy of @Aconite33

[TheTechromancer]

• Make sure every cli 'list' can filter by host, domain, and target
  • Finding target filter doesn't work - needs cli test (fixed in Fix finding filter #42)
• Update top level cli command help to include sub commands
• Feature: Delete scan (including events)
• Add module: URLs
• Add module: Web screenshots
• Support builtin presets (QoL Feature Request #47)
• Speed up target loading
  • While reworking targets, should keep stats on event types (e.g. this target has 12 domains, 4 ips, and 6 URLs))
• Add CLI date filtering to activities, events
• Associate activities to a scan and allow querying by scans (so you can see exactly what new stuff the scan found)
• Tests for what happens when you try to ingest 2 scans with the same name
• Error when using | head:

$ bbctl activity list --json | head | jq

[CRITICAL] Traceback (most recent call last):
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpx/_client.py", line 1590, in stream
    yield response
  File "/home/bls/Downloads/code/bbot-server-proto/bbot_server/interfaces/http.py", line 133, in _http_stream
    yield model_obj
GeneratorExit

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/bls/Downloads/code/bbot-server-proto/bbot_server/interfaces/http.py", line 309, in _handle_httpx_error
    yield
  File "/home/bls/Downloads/code/bbot-server-proto/bbot_server/interfaces/http.py", line 114, in _http_stream
    async with self.client.stream(method=method, url=_url, json=body) as response:
               ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/contextlib.py", line 235, in __aexit__
    await self.gen.athrow(value)
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpx/_client.py", line 1592, in stream
    await response.aclose()
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpx/_models.py", line 1076, in aclose
    await self.stream.aclose()
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpx/_client.py", line 182, in aclose
    await self._stream.aclose()
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpx/_transports/default.py", line 276, in aclose
    await self._httpcore_stream.aclose()
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpcore/_async/connection_pool.py", line 412, in aclose
    with AsyncShieldCancellation():
         ~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpcore/_synchronization.py", line 203, in __init__
    self._backend = current_async_library()
                    ~~~~~~~~~~~~~~~~~~~~~^^
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/httpcore/_synchronization.py", line 30, in current_async_library
    environment = sniffio.current_async_library()
  File "/home/bls/.cache/pypoetry/virtualenvs/bbot-server-DmHQwTaK-py3.13/lib/python3.13/site-packages/sniffio/_impl.py", line 93, in current_async_library
    raise AsyncLibraryNotFoundError(
        "unknown async library, or not in async context"
    )
sniffio._impl.AsyncLibraryNotFoundError: unknown async library, or not in async context

Exception ignored in: <async_generator object http._http_stream at 0x7f6679505fe0>
Traceback (most recent call last):
  File "/home/bls/Downloads/code/bbot-server-proto/bbot_server/interfaces/http.py", line 112, in _http_stream
    with self._handle_httpx_error(method, _url):
  File "/usr/lib/python3.13/contextlib.py", line 162, in __exit__
    self.gen.throw(value)
  File "/home/bls/Downloads/code/bbot-server-proto/bbot_server/interfaces/http.py", line 316, in _handle_httpx_error
    raise BBOTServerError(f"Error making {method} request -> {_url}: {e}") from e
bbot_server.errors.BBOTServerError: Error making GET request -> http://localhost:8807/v1/activity/list: unknown async library, or not in async context

FYSA @aconite33

[TheTechromancer]

According to cProfile, the main culprit of the CLI delay is fastapi's schema generation.

         2588193 function calls (2497107 primitive calls) in 2.196 seconds

   Ordered by: cumulative time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
      154    0.003    0.000    6.478    0.042 __init__.py:1(<module>)
   1262/3    0.008    0.000    2.120    0.707 <frozen importlib._bootstrap>:1349(_find_and_load)
   1251/3    0.006    0.000    2.120    0.707 <frozen importlib._bootstrap>:1304(_find_and_load_unlocked)
   2718/7    0.002    0.000    2.120    0.303 <frozen importlib._bootstrap>:480(_call_with_frames_removed)
   1201/5    0.005    0.000    2.120    0.424 <frozen importlib._bootstrap>:911(_load_unlocked)
   1162/4    0.003    0.000    2.119    0.530 <frozen importlib._bootstrap_external>:1020(exec_module)
   226/25    0.001    0.000    1.932    0.077 {built-in method builtins.__import__}
   1328/1    0.042    0.000    1.203    1.203 {built-in method builtins.exec}
      2/1    0.001    0.001    1.203    1.203 bbctl:1(<module>)
      2/1    0.000    0.000    1.164    1.164 bbctl.py:87(main)
       17    0.000    0.000    1.144    0.067 base.py:1(<module>)
      2/1    0.000    0.000    1.126    1.126 bbctl.py:25(__init__)
     13/1    0.001    0.000    1.126    1.126 base.py:52(__init__)
3422/3005    0.045    0.000    0.990    0.000 {built-in method builtins.__build_class__}
3874/3421    0.004    0.000    0.892    0.000 <frozen importlib._bootstrap>:1390(_handle_fromlist)
       25    0.001    0.000    0.854    0.034 __init__.py:114(load_python_file)
        4    0.000    0.000    0.716    0.179 config.py:1(<module>)
      254    0.007    0.000    0.675    0.003 _model_construction.py:80(__new__)
       11    0.000    0.000    0.618    0.056 errors.py:1(<module>)
        2    0.000    0.000    0.608    0.304 applications.py:1(<module>)
        2    0.000    0.000    0.594    0.297 routing.py:1(<module>)
        5    0.000    0.000    0.531    0.106 models.py:1(<module>)
      256    0.007    0.000    0.528    0.002 _model_construction.py:562(complete_model_class)
        1    0.000    0.000    0.522    0.522 findings_api.py:1(<module>)
        1    0.000    0.000    0.512    0.512 _root.py:1(<module>)
        2    0.000    0.000    0.511    0.255 params.py:1(<module>)
        6    0.000    0.000    0.510    0.085 server.py:1(<module>)
 2318/258    0.007    0.000    0.434    0.002 _generate_schema.py:679(generate_schema)
 3836/258    0.015    0.000    0.429    0.002 _generate_schema.py:978(_generate_schema_inner)
  810/260    0.014    0.000    0.423    0.002 _generate_schema.py:718(_model_schema)
        1    0.000    0.000    0.393    0.393 _routing.py:1(<module>)
        1    0.000    0.000    0.392    0.392 mcp.py:1(<module>)
 1549/984    0.030    0.000    0.383    0.000 _generate_schema.py:1347(_common_field_schema)