embedding vectors + bulk

[MichaelLukowski]

New Features

Class to handle embedding vectors that come from the Embedding Management Service
Bulk indexd files class to accommodate a bulk endpoint for signed urls

POST /data/download/bulk bulk endpoint for signed urls. This requires the user to POST a list of signed urls
e.x. payload:

{
	"guids": ["dev/4d3ffd8e-2c0f-4ba3-a3a3-c99068b3dcd1",
		"dev/4d3ffd8e-2c0f-4ba3-a3a3-c99068b3dcd1",
		"dev/4d3ffd8e-2c0f-4ba3-a3a3-c99068b3dcd1",
		"dev/4d3ffd8e-2c0f-4ba3-a3a3-c99068b3dcd1"]
}

POST /data/upload/vector vector uploading endpoint. Very similar to the normal /data/upload but requires the need to take in a vector and model
e.x. payload:

{
    "authz": [
        "/programs/DEV"
    ],
    "model": "expr",
    "file_id": "1234",
    "embedding": [1,2,3,4]
}

Breaking Changes

None

[coveralls]

Pull Request Test Coverage Report for Build 20935218274

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 248 unchanged lines in 2 files lost coverage.
• Overall coverage decreased (-1.2%) to 73.769%

---

Files with Coverage Reduction	New Missed Lines	%
blueprints/data/blueprint.py	61	70.64%
blueprints/data/indexd.py	187	77.26%

Totals
Change from base Build 20076693184:	-1.2%
Covered Lines:	8451
Relevant Lines:	11456

---

💛 - Coveralls

[github-actions]

filepath	passed	skipped	SUBTOTAL
tests/test_oauth2.py	15	0	15
tests/test_centralized_auth.py	16	0	16
tests/test_audit_service.py	3	3	6
tests/test_data_upload.py	8	1	9
tests/test_presigned_url.py	7	0	7
tests/test_user_token.py	5	0	5
tests/test_dbgap.py	4	1	5
tests/test_drs_endpoint.py	4	0	4
tests/test_client_credentials.py	1	0	1
tests/test_register_user.py	2	0	2
tests/test_oidc_client.py	2	0	2
tests/test_google_data_access.py	1	0	1
tests/test_ras_authn.py	0	3	3
TOTAL	68	8	76

Please find the detailed integration test report here

Please find the Github Action logs here

[github-actions]

filepath	passed	skipped	SUBTOTAL
tests/test_oauth2.py	15	0	15
tests/test_centralized_auth.py	16	0	16
tests/test_audit_service.py	3	3	6
tests/test_data_upload.py	8	1	9
tests/test_presigned_url.py	7	0	7
tests/test_dbgap.py	4	1	5
tests/test_drs_endpoint.py	4	0	4
tests/test_oidc_client.py	2	0	2
tests/test_client_credentials.py	1	0	1
tests/test_register_user.py	2	0	2
tests/test_user_token.py	5	0	5
tests/test_google_data_access.py	1	0	1
tests/test_ras_authn.py	0	3	3
TOTAL	68	8	76

Please find the detailed integration test report here

Please find the Github Action logs here

[github-actions]

filepath	SUBTOTAL
TOTAL	0

Please find the detailed integration test report here

Please find the Github Action logs here