Dataset: ICLR In this assignment, we are working with manuscripts and their reviews from a famous CS conference, ICLR (International Conference on Learning Representations). This is a top conference i

Dataset: ICLR

In this assignment, we are working with manuscripts and their reviews from a famous CS conference, ICLR (International Conference on Learning Representations). This is a top conference in computer science on machine learning.

Each manuscript have 2 – 3 reviews. Each row in the training.csv and test_contentonly.csv represent a review to a specific manuscript. They contains the following columns

  • id: id of manuscript
  • reviewer_name: name of reviewer for this manuscript
  • title: title of the manuscript
  • abstract: abstract of the manuscript
  • comments: review texts of this manuscript by a specific reviewer
  • decision: final decision (1 if the manuscript was accepted or 0 otherwise).

The decision column was not directly listed in the test_contentonly.csv. Instread, it was listed in test_label.csv.

Grading policy

We will grade based on your code notebook (Python notebook or R markdown file) on GitHub. Your codes should have clear documentations of the process you take and decisions you have made. Also discuss your results when appropriate (see the problem descriptions below).

1. Supervised methods (60 pts) Please use Python or R to do the assignment 

In this task, you need to predict whether a manuscript is accepted (1) or rejected (0), based on the review texts.

1.1 Dictionary method (20 pts)

Use the dictionary method to predict whether manuscripts in the test data were accepted or rejected.

  • list the dictionaries you used
  • Discuss how you construct your dictionary (e.g., by reading and summarizing, using embedding, etc).

1.2 Supervised methods (20 pts)

Use the dictionary method to predict whether manuscripts in the test data were accepted or rejected, using training.csv as the training data.

1.3 Evaluation (20 pts)

  • Compare supervised learning’s performance with dictionary methods, based on the testdata. The correct labels are provided in test_label.csv. Report the following:
    • Precision
    • Recall
    • F1 score
    • AUC score (of ROC curves).
  • Discuss whether supervised methods or dictionary methods yield better performance. And what makes you achieve a good prediction performance?

Show more







Calculate Your Essay Price
(550 words)

Approximate price: $22

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
$26
The price is based on these factors:
Academic level
Number of pages
Urgency
Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

Delivering a high-quality product at a reasonable price is not enough anymore.
That’s why we have developed 5 beneficial guarantees that will make your experience with our service enjoyable, easy, and safe.

Money-back guarantee

You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.

Read more

Zero-plagiarism guarantee

Each paper is composed from scratch, according to your instructions. It is then checked by our plagiarism-detection software. There is no gap where plagiarism could squeeze in.

Read more

Free-revision policy

Thanks to our free revisions, there is no way for you to be unsatisfied. We will work on your paper until you are completely happy with the result.

Read more

Privacy policy

Your email is safe, as we store it according to international data protection rules. Your bank details are secure, as we use only reliable payment systems.

Read more

Fair-cooperation guarantee

By sending us your money, you buy the service we provide. Check out our terms and conditions if you prefer business talks to be laid out in official language.

Read more

Order your essay today and save 10% with the coupon code: best10