Create the golden evaluation dataset#8
Open
ElyssaN wants to merge 1 commit into
Open
Conversation
AJaccP
requested changes
Jun 14, 2026
AJaccP
left a comment
AJaccP
left a comment
Contributor
There was a problem hiding this comment.
Great work overall! Just noticed a couple of small things that could use fixes, it'll be good to merge after.
| @@ -0,0 +1,98 @@ | |||
| - question: "What courses should I take in first year?" | |||
Contributor
There was a problem hiding this comment.
Two URLs seem to go to a 404 page:
https://carleton.ca/academicadvising/reduced-course-load-2/-> Replace withhttps://carleton.ca/academicadvising/reduced-course-load/https://carleton.ca/academicadvising/year-standing/-> Looks like this page has it as a section now, so replace with:https://carleton.ca/academicadvising/degree-requirements/
| - "https://ccss.carleton.ca/resources/faqs/comp-1005-1006-vs-1405-1406/" | ||
|
|
||
| - question: "When can I register for courses?" | ||
| expected_answer: "You can register for courses based on your time ticket, which you can find in the 'getting started' section of the registration menu in Carleton Central. Incoming first-year students can register between July 2nd and July 4th, 2025, while returning upper-year students can register between July 8th and July 11th, 2025. It's strongly recommended to register as soon as your time ticket opens, but you can make changes until a few weeks into the semester, and check the academic calendar for specific adding/dropping deadlines." |
Contributor
There was a problem hiding this comment.
Includes time bound content between July 2nd and July 4th, 2025, while returning upper-year students can register between July 8th and July 11th, 2025
It's taken from the CCSS FAQs which do the same thing so that's on us, I'll flag it as a thing we should fix on those pages. For the eval dataset though, I'd just generalize the phrasing to remove any time bound content (likely just remove that sentence with dates in it for now)
| - "https://carleton.ca/registration/academic-dates/" | ||
| - "https://carleton.ca/registration/waitlisting/" | ||
|
|
||
| - question: "How many courses should I taken in a semester?" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #2