Draft: Made changes to roadmap (added graphics, new info, and changed wording)#994
Draft: Made changes to roadmap (added graphics, new info, and changed wording)#994daniellawright wants to merge 1 commit into
Conversation
| - **HTCondor** is a job scheduling software that will run your jobs out on the execution points. | ||
| - The **Execution Points** are the set of resources your job runs on. | ||
|
|
||
| High Throughput Computing systems specialize in running tens to millions small, independent jobs. On the other hand, High Performance Computing systems specialize in running a few, very large jobs that use multiple computers working together on the same problem. |
There was a problem hiding this comment.
| High Throughput Computing systems specialize in running tens to millions of small, independent jobs. On the other hand, High Performance Computing systems specialize in running a few, very large jobs that use multiple computers working together on the same problem. |
| <td>X</td> | ||
| <td>✓</td> | ||
| <tr> | ||
| <td>Examples</td> |
There was a problem hiding this comment.
| <td>Example tasks</td> |
| More detailed information regarding CHTC's HTC system can be found in the <a href="https://chtc.cs.wisc.edu/uw-research-computing/htc-overview">⚙️ HTC Overview Guide</a>. | ||
|
|
||
| #### Step Two | ||
| ### Step Two: Set Up Your Account and Submit Your First Job |
There was a problem hiding this comment.
I think we should keep the logging in and submitting jobs steps separate. Originally, we wanted to merge them because the logging in section was quite short initially, but with your changes and the cool new graphic, I think it can stand in its own section.
| After following this tutorial, we <b>highly recommend</b> users review the <a href="https://chtc.cs.wisc.edu/uw-research-computing/multiple-jobs">Easily Submit Multiple Jobs</a> guide to learn how you can configure HTCondor to automatically pass files or parameters to different jobs, return output to specific directories, and other easily automated organizational behaviors. | ||
| <br> | ||
| </details> | ||
| The tutorial below shows how to run many jobs from one submit file, use different input files or settings for each job, and save output files in specific directories. |
There was a problem hiding this comment.
| The tutorial below shows how to run many jobs from one submit file, use different input files or settings for each job, and save output files in specific directories. | |
| The following guide demonstrates different examples on how to run multiple jobs from one submit file, use different input files or settings for each job, and save output files in specific directories. |
| <details> | ||
| <summary>Install your Software</summary> | ||
| <br> | ||
| Our <a href="https://chtc.cs.wisc.edu/uw-research-computing/htc/guides.html">Software Solutions</a> guides contain information about how to install and use software on the HTC system. |
There was a problem hiding this comment.
| Our <a href="https://chtc.cs.wisc.edu/uw-research-computing/htc/guides.html">Software Solutions</a> guides contain information about how to install and use software on the HTC system. | |
| Our <a href="htc/guides#software">software</a> guides contain information about how to install and use software on the HTC system. |
| After your test jobs finish, we recommend you check for: | ||
|
|
||
| - Jobs that were placed on hold. You can view hold messages with <code>condor_q jobID -hold</code>. | ||
| - Expected output files. |
There was a problem hiding this comment.
| - Expected output files. | |
| - Expected output files - are they in the right location, and do they show the expected output? |
|
|
||
| - Jobs that were placed on hold. You can view hold messages with <code>condor_q jobID -hold</code>. | ||
| - Expected output files. | ||
| - The size and number of output files. This helps you make sure files are being saved in the correct location and that your quota is large enough for your output data when you submit more jobs. |
There was a problem hiding this comment.
| - The size and number of output files. This helps you make sure files are being saved in the correct location and that your quota is large enough for your output data when you submit more jobs. | |
| - The size and number of output files. This helps you make sure that your quota is large enough for your output data when you submit more jobs. |
| - Expected output files. | ||
| - The size and number of output files. This helps you make sure files are being saved in the correct location and that your quota is large enough for your output data when you submit more jobs. | ||
|
|
||
| If your first test job works as expected, run a small batch next, such as 5 to 10 jobs. This gives you a chance to test your workflow at a slightly larger scale before submitting everything. |
There was a problem hiding this comment.
| If your first test job works as expected, run a small batch next, such as 5 to 10 jobs. This gives you a chance to test your workflow at a slightly larger scale before submitting everything. | |
| If your first test job works as expected, scale up your test by running a small batch next, such as 5 to 10 jobs. This gives you a chance to test your workflow at a slightly larger scale and ensure your pipeline works before submitting everything. |
|
|
||
| If your first test job works as expected, run a small batch next, such as 5 to 10 jobs. This gives you a chance to test your workflow at a slightly larger scale before submitting everything. | ||
|
|
||
| When the small batch finishes, review the output files and check your available storage space, also called your **quota**. This will help you estimate whether you have enough space for the files your full workflow will create. |
There was a problem hiding this comment.
| When the small batch finishes, review the output files and check your available storage space, also called your **quota**. This will help you estimate whether you have enough space for the files your full workflow will create. | |
| When the small batch finishes, review the output files and [check your available storage space](check-quota), also called your **quota**. This will help you estimate whether you have enough space for the files your full workflow will create. |
|
|
||
| When the small batch finishes, review the output files and check your available storage space, also called your **quota**. This will help you estimate whether you have enough space for the files your full workflow will create. | ||
|
|
||
| If the test jobs finish successfully and your quota is large enough, you are ready to submit your full workflow! |
There was a problem hiding this comment.
| If the test jobs finish successfully and your quota is large enough, you are ready to submit your full workflow! | |
| > If the test jobs finish successfully and your quota is large enough, you are ready to submit your full workflow! |
Putting this in a block quote for emphasis.
|
@daniellawright All of this looks great! The RCF team loves how clear your graphics are, and the writing is pretty clear and organized. Most of the suggestions I made are very minor language changes, or things that RCFs wanted to emphasize that you may not have known. Beside the suggested changes, we discussed breaking this up into separate pages or keeping as one long page. For now, we propose keeping it as one page with some modifications:
I think it looks great, and we're very close to finalizing the new roadmap! |
No description provided.