Repository navigation
Commit 3f11cb0
committed
fix(service): Lower the body share of one client to 16 MiB
With 32 MiB, 4 IPv4 addresses or 4 /64s could fill the 128 MiB budget
of runs without a token. With 16 MiB it takes 8. 16 MiB is still one
body of the largest size, or about 25 of the largest model requests.
The README said that a client with a /48 holds the budget "for 30 s at
a time". A body gets HTTP 408 after 30 s, but the client can start the
next one at once, so the hold does not stop.1 parent 4bd94e5 commit 3f11cb0
3 files changed
Lines changed: 13 additions & 15 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
698 | 698 | | |
699 | 699 | | |
700 | 700 | | |
701 | | - | |
| 701 | + | |
702 | 702 | | |
703 | 703 | | |
704 | 704 | | |
| |||
725 | 725 | | |
726 | 726 | | |
727 | 727 | | |
728 | | - | |
| 728 | + | |
| 729 | + | |
729 | 730 | | |
730 | 731 | | |
731 | 732 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
173 | 173 | | |
174 | 174 | | |
175 | 175 | | |
176 | | - | |
177 | | - | |
| 176 | + | |
| 177 | + | |
178 | 178 | | |
179 | | - | |
| 179 | + | |
180 | 180 | | |
181 | 181 | | |
182 | 182 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
806 | 806 | | |
807 | 807 | | |
808 | 808 | | |
809 | | - | |
| 809 | + | |
810 | 810 | | |
811 | 811 | | |
812 | 812 | | |
813 | | - | |
| 813 | + | |
814 | 814 | | |
815 | 815 | | |
816 | 816 | | |
| |||
861 | 861 | | |
862 | 862 | | |
863 | 863 | | |
864 | | - | |
| 864 | + | |
865 | 865 | | |
866 | 866 | | |
867 | 867 | | |
| |||
872 | 872 | | |
873 | 873 | | |
874 | 874 | | |
875 | | - | |
876 | | - | |
877 | | - | |
878 | | - | |
| 875 | + | |
879 | 876 | | |
880 | 877 | | |
881 | 878 | | |
| |||
942 | 939 | | |
943 | 940 | | |
944 | 941 | | |
945 | | - | |
| 942 | + | |
946 | 943 | | |
947 | | - | |
| 944 | + | |
948 | 945 | | |
949 | 946 | | |
950 | | - | |
| 947 | + | |
951 | 948 | | |
952 | 949 | | |
953 | 950 | | |
| |||
0 commit comments