学术论文评审_academic-paper-review

以下为本文档的中文说明Academic Paper Review 是一个专业的学术论文评审技能能够自动生成结构化的、达到顶级同行评审质量标准的论文深度分析报告。该技能严格模仿顶级学术会议和期刊的评审标准包括 NeurIPS、ICML、ACL、Nature 和 IEEE 等提供严谨、建设性和全面平衡的学术评估。评审维度涵盖摘要总结、优势分析、劣势识别、方法论评估、贡献评价、文献定位以及可操作的改进建议等所有评估结论均基于论文本身的证据杜绝主观臆断。使用场景非常广泛当研究者或审稿人需要快速了解一篇论文的整体质量、创新性和局限性时当需要从上传的 PDF 文件或 arXiv 链接中自动提取论文内容并生成结构化评审报告时当需要深入评估方法论的严谨性、实验设计的有效性以及统计验证的可靠性时当需要系统评估论文的创新程度、与现有工作的区别和对学术文献的定位贡献时。该技能适用于学术界的论文评审、内部同行评议、文献综述撰写以及对预印本的快速质量评估等多种场景。核心特点与原则包括第一结构化评审框架——评审内容覆盖摘要、优势、劣势、方法论评估、贡献评价、文献定位和可操作建议等多个标准化维度。第二基于证据的评估原则——所有评审结论必须严格基于论文本身的证据和数据杜绝主观臆断和偏见。第三方法论严谨性评估——深入分析实验设计的科学性、统计验证的有效性以及研究结果的可复现性。第四创新性系统评估——科学评估论文与现有工作的实质性区别和贡献程度。第五自动解析能力——能够从上传的 PDF 文件或网络 URL 中自动解析学术论文的完整内容无需手动输入论文信息。第六严格遵循顶级会议评审模板——按照 NeurIPS、ICML 等顶级会议的标准模板组织评审报告结构。Academic Paper Review SkillOverviewThis skill produces structured, peer-review-quality analyses of academic papers and research publications. It follows established academic review standards used by top-tier venues (NeurIPS, ICML, ACL, Nature, IEEE) to provide rigorous, constructive, and balanced assessments.The review coverssummary, strengths, weaknesses, methodology assessment, contribution evaluation, literature positioning, and actionable recommendations— all grounded in evidence from the paper itself.Core CapabilitiesParse and comprehend academic papers from uploaded PDFs or fetched URLsGenerate structured reviews following top-venue review templatesAssess methodology rigor (experimental design, statistical validity, reproducibility)Evaluate novelty and significance of contributionsPosition the work within the broader research landscape via targeted literature searchIdentify limitations, gaps, and potential improvementsProduce both detailed review and concise executive summary formatsSupport papers in any scientific domain (CS, biology, physics, social sciences, etc.)When to Use This SkillAlways load this skill when:User provides a paper URL (arXiv, DOI, conference proceedings, journal link)User uploads a PDF of a research paper or preprintUser asks to “review”, “analyze”, “critique”, “assess”, or “summarize” a research paperUser wants to understand the strengths and weaknesses of a studyUser requests a peer-review-style evaluation of academic workUser asks for help preparing a review for a conference or journal submissionReview MethodologyPhase 1: Paper ComprehensionThoroughly read and understand the paper before forming any judgments.Step 1.1: Identify Paper MetadataExtract and record:FieldDescriptionTitleFull paper titleAuthorsAuthor list and affiliationsVenue / StatusPublication venue, preprint server, or submission statusYearPublication or submission yearDomainResearch field and subfieldPaper TypeEmpirical, theoretical, survey, position paper, systems paper, etc.Step 1.2: Deep Reading PassRead the paper systematically:Abstract Introduction— Identify the claimed contributions and motivationRelated Work— Note how authors position their work relative to prior artMethodology— Understand the proposed approach, model, or framework in detailExperiments / Results— Examine datasets, baselines, metrics, and reported outcomesDiscussion Limitations— Note any self-identified limitationsConclusion— Compare concluded claims against actual evidence presentedStep 1.3: Key Claims ExtractionList the paper’s main claims explicitly:Claim 1: [Specific claim about contribution or finding] Evidence: [What evidence supports this claim in the paper] Strength: [Strong / Moderate / Weak] Claim 2: [...] ...Phase 2: Critical AnalysisStep 2.1: Literature Context SearchUse web search to understand the research landscape:Search queries: - [paper topic] state of the art [current year] - [key method name] comparison benchmark - [authors] previous work [topic] - [specific technique] limitations criticism - survey [research area] recent advancesUseweb_fetchon key related papers or surveys to understand where this work fits.Step 2.2: Methodology AssessmentEvaluate the methodology using the following framework:CriterionQuestions to AskRatingSoundnessIs the approach technically correct? Are there logical flaws?1-5NoveltyWhat is genuinely new vs. incremental improvement?1-5ReproducibilityAre details sufficient to reproduce? Code/data available?1-5Experimental DesignAre baselines fair? Are ablations adequate? Are datasets appropriate?1-5Statistical RigorAre results statistically significant? Error bars reported? Multiple runs?1-5ScalabilityDoes the approach scale? Are computational costs discussed?1-5Step 2.3: Contribution Significance AssessmentEvaluate the significance level:LevelDescriptionCriteriaLandmarkFundamentally changes the fieldNew paradigm, widely applicable breakthroughSignificantStrong contribution advancing the state of the artClear improvement with solid evidenceModerateUseful contribution with some limitationsIncremental but valid improvementMarginalMinimal advance over existing workSmall gains, narrow applicabilityBelow thresholdDoes not meet publication standardsFundamental flaws, insufficient evidenceStep 2.4: Strengths and Weaknesses AnalysisFor each strength or weakness, provide:What: Specific observationWhere: Section/figure/table referenceWhy it matters: Impact on the paper’s claims or utilityPhase 3: Review SynthesisStep 3.1: Assemble the Structured ReviewProduce the final review using the template below.Review Output Template# Paper Review: [Paper Title] ## Paper Metadata - **Authors**: [Author list] - **Venue**: [Publication venue or preprint server] - **Year**: [Year] - **Domain**: [Research field] - **Paper Type**: [Empirical / Theoretical / Survey / Systems / Position] ## Executive Summary [2-3 paragraph summary of the papers core contribution, approach, and main findings. State your overall assessment upfront: what the paper does well, where it falls short, and whether the contribution is sufficient for the claimed venue/impact level.] ## Summary of Contributions 1. [First claimed contribution — one sentence] 2. [Second claimed contribution — one sentence] 3. [Additional contributions if any] ## Strengths ### S1: [Concise strength title] [Detailed explanation with specific references to sections, figures, or tables in the paper. Explain WHY this is a strength and its significance.] ### S2: [Concise strength title] [...] ### S3: [Concise strength title] [...] ## Weaknesses ### W1: [Concise weakness title] [Detailed explanation with specific references. Explain the impact of this weakness on the papers claims. Suggest how it could be addressed.] ### W2: [Concise weakness title] [...] ### W3: [Concise weakness title] [...] ## Methodology Assessment | Criterion | Rating (1-5) | Assessment | |-----------|:---:|------------| | Soundness | X | [Brief justification] | | Novelty | X | [Brief justification] | | Reproducibility | X | [Brief justification] | | Experimental Design | X | [Brief justification] | | Statistical Rigor | X | [Brief justification] | | Scalability | X | [Brief justification] | ## Questions for the Authors 1. [Specific question that would clarify a concern or ambiguity] 2. [Question about methodology choices or alternative approaches] 3. [Question about generalizability or practical applicability] ## Minor Issues - [Typos, formatting issues, unclear figures, notation inconsistencies] - [Missing references that should be cited] - [Suggestions for improved clarity] ## Literature Positioning [How does this work relate to the current state of the art? Are key related works cited? Are comparisons fair and comprehensive? What important related work is missing?] ## Recommendations **Overall Assessment**: [Accept / Weak Accept / Borderline / Weak Reject / Reject] **Confidence**: [High / Medium / Low] — [Justification for confidence level] **Contribution Level**: [Landmark / Significant / Moderate / Marginal / Below threshold] ### Actionable Suggestions for Improvement 1. [Specific, constructive suggestion] 2. [Specific, constructive suggestion] 3. [Specific, constructive suggestion]Review PrinciplesConstructive CriticismAlways suggest how to fix it— Don’t just point out problems; propose solutionsGive credit where due— Acknowledge genuine contributions even in flawed papersBe specific— Reference exact sections, equations, figures, and tablesSeparate minor from major— Distinguish fatal flaws from fixable issuesObjectivity Standards❌ “This paper is poorly written” (vague, unhelpful)✅ “Section 3.2 introduces notation X without formal definition, making the proof in Theorem 1 difficult to follow. Consider adding a notation table after the problem formulation.” (specific, actionable)Ethical Review PracticesDo NOT dismiss work based on author reputation or affiliationEvaluate the work on its own meritsFlag potential ethical concerns (bias in datasets, dual-use implications) constructivelyMaintain confidentiality of unpublished workAdaptation by Paper TypePaper TypeFocus AreasEmpiricalExperimental design, baselines, statistical significance, ablations, reproducibilityTheoreticalProof correctness, assumption reasonableness, tightness of bounds, connection to practiceSurveyComprehensiveness, taxonomy quality, coverage of recent work, synthesis insightsSystemsArchitecture decisions, scalability evidence, real-world deployment, engineering contributionsPositionArgument coherence, evidence for claims, impact potential, fairness of characterizationsCommon Pitfalls to Avoid❌ Reviewing the paper you wish was written instead of the paper that was submitted❌ Demanding additional experiments that are unreasonable in scope❌ Penalizing the paper for not solving a different problem❌ Being overly influenced by writing quality versus technical contribution❌ Treating absence of comparison to your own work as a weakness❌ Providing only a summary without critical analysisQuality ChecklistBefore finalizing the review, verify:Paper was read completely (not just abstract and introduction)All major claims are identified and evaluated against evidenceAt least 3 strengths and 3 weaknesses are provided with specific referencesThe methodology assessment table is complete with ratings and justificationsQuestions for authors target genuine ambiguities, not rhetorical critiquesLiterature search was conducted to contextualize the contributionRecommendations are actionable and constructiveThe overall assessment is consistent with the identified strengths and weaknessesThe review tone is professional and respectfulMinor issues are separated from major concernsOutput FormatOutput the complete review inMarkdownformatSave the review to/mnt/user-data/outputs/review-{paper-topic}.mdwhen working in sandboxPresent the review to the user using thepresent_filestoolNotesThis skill complements thedeep-researchskill — load both when the user wants the paper reviewed in the context of the broader fieldFor papers behind paywalls, work with whatever content is accessible (abstract, publicly available versions, preprint mirrors)Adapt the review depth to the user’s needs: a brief assessment for quick triage versus a full review for submission preparationWhen reviewing multiple papers comparatively, maintain consistent criteria across all reviewsAlways disclose limitations of your review (e.g., “I could not verify the proofs in Appendix B in detail”)3c:[“,,,L46”,null,{“content”:“$47”,“frontMatter”:{“name”:“academic-paper-review”,“description”:“Use this skill when the user requests to review, analyze, critique, or summarize academic papers, research articles, preprints, or scientific publications. Supports comprehensive structured reviews covering methodology assessment, contribution evaluation, literature positioning, and constructive feedback generation. Trigger on queries involving paper URLs, uploaded PDFs, arXiv links, or requests like \“review this paper\”, \“analyze this research\”, \“summarize this study\”, or \“write a peer review\”.”}}]