#SoftwareReview

0 posts0 participants0 posts today

rOpenSci7/8 📦 Looking to submit your package?If you have an R package that you believe should undergo peer review, submit it to our open peer review system: <a href="https://github.com/ropensci/software-review" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/ropensci/software-review</a> Let’s ensure it meets the highest standards of quality and usability! <a href="https://hachyderm.io/tags/PeerReviewWeek" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PeerReviewWeek</a> <a href="https://hachyderm.io/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenSource</a> <a href="https://hachyderm.io/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a>

rOpenSci3/8 🛠️ What makes rOpenSci’s peer review special?Our process goes beyond traditional academic peer review. It focuses on code quality, documentation, and community standards: <a href="https://devguide.ropensci.org/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://devguide.ropensci.org/</a> It’s a collaborative effort, with authors, reviewers and editors growing through the process. <a href="https://hachyderm.io/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a> <a href="https://hachyderm.io/tags/OpenScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenScience</a>

jonny (good kind)<a href="https://neuromatch.social/@neuralreckoning" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@neuralreckoning</a> <a href="https://neuromatch.social/@adredish" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@adredish</a> <a href="https://mastodon.social/@WorldImagining" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@WorldImagining</a> <a href="https://mastodon.social/@mschottdorf" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@mschottdorf</a> <a href="https://mastodon.social/@brembs" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@brembs</a> butting in late on this discussion (thanks all for your thoughts) and as usual I want to inject a little <a href="https://fosstodon.org/@joss" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@joss</a> model into the conversation since it's a really good, live, successful experiment in a lot of these ideas.<blockquote>In my experience, none of the "let's let readers provide comment/review if they want" has worked because it's really rare that people want to write the deep-dive that a good review requires</blockquote>I get this objection, and so I think opportunistic review is just one of many parts of a more functional review system. This should just be trivially possible for any artifact of scholarly work, but it does require shifting what we think 'scholarly publishing' bodies can be. That would require not only moderation of a peer review process, but moderation of a community and place of digital archival-grade discussion - that's more or less what neuromatch.social is an experiment in making. My own experiences with opportunistic review have been really great, with lots of good commentary from domain experts, both supportive and critical, that directly accompanies the work and makes it richer for experts and nonexperts alike. Really love what <a href="https://neuromatch.social/@neuralreckoning" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@neuralreckoning</a> is saying here:<blockquote>Here's my suggestion: give authors an easy way to recognise valuable peer reviews that improved a paper by giving them the option to add them as authors.</blockquote>and think this is another place where JOSS really works. Scientific experiments are different than software in a lot of ways, obviously, but one thing JOSS shows us about structured post-pub peer review is how in addition to raising issues, reviewers can do pull requests and propose contributions to the work. in software this results in automatic credit - you are the author of the commits that were merged - that is strictly positive for both parties: there is no limit on number of contributors, it's super clear what that person did, etc. A really healthy model of review would be one where reviewers could also contribute to the work and were seen as co-contributors. Experiments have much longer timescales, material restrictions, etc. for making contributions like that, but one could also see that as being part of author responsibility, to make their methods portable/reproducible enough that they could eg. loan some equipment to another lab so they could collaborate and contribute to an experiment. that happens already as collaborations, so you could see how this would be relatively hazy barrier between "peer review" and "working in public." when i'm reviewing software, I have actually a lot of motivation because i learn a lot from it, and that would be another part - if review was structured in a way to improve the work, then one could imagine a first pass at a review being "methods sharing" - not just evaluating the text, but collaboratively trying to figure out how to make it so the reviewers-as-collaborators could actually recreate the experiment and use that to improve the methods section. because it's public, i have additional reputational motivation to review, and disincentive to be toxic and rude. Demonstrating a track record of thoughtful feedback and cooperative behavior is super good for being able to look for work - win/win. The question of legibility to an outside audience is often a matter of process and interface design to me. A marker of "having gone through peer review process x" is meaningful in a way that "being published in venue y" is not, because in the latter case it's an existential question for the work - something can only be in one <code>y</code> and it must be in some <code>y</code> to exist. Going through a voluntary peer review process with a clear and transparent standards process (alongside the complete artifact of the review) is legible both to "outsiders" (assuming the process has some legible documentation, which is not necessarily a given) and insiders. Labels and open processes are v much not in conflict, but when labels are venues they are just qualitatively different.so all these approaches are complementary to me - opportunistic peer review for everything against a background of collective moderation, structured peer review as a constructive process of trying to get a work to meet some standard with reviewers as both cooperators and adversaries in different roles, but untied to the mere existence of a work.<a href="https://neuromatch.social/tags/PeerReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PeerReview</a> <a href="https://neuromatch.social/tags/ScholComm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ScholComm</a> <a href="https://neuromatch.social/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a>

jonny (good kind)Call for <a href="https://fosstodon.org/@joss" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@joss</a> reviewers:EdgeVPN.io repo: <a href="https://github.com/EdgeVPNio/evio" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/EdgeVPNio/evio</a> pre-review: <a href="https://github.com/openjournals/joss-reviews/issues/6355" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/openjournals/joss-reviews/issues/6355</a> language: PythonDescription:<blockquote>EdgeVPN.io is an evolution of the IP-over-P2P (IPOP) project. IPOP started as an IP-based peer-to-peer overlay targeting personal devices, and over time the architecture evolved to adopt various standards, support centralized user/group management, and incorporate software-defined networking, culminating in the current architecture, tailored for research and development in nascent edge computing applications. ... EdgeVPNio is a research project to build networking for the fog, spanning the network continuum from the cloud to its edge. It builds networking cyber-infrastructure which supports emerging IoT era applications.</blockquote>Looks like this one might be a bit of fun for <a href="https://neuromatch.social/tags/p2p" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#p2p</a> people, or i suppose <a href="https://neuromatch.social/tags/DistributedSystems" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DistributedSystems</a> people generally. No prior experience reviewing for JOSS is required, experience with Python is required, and some experience with the topic area is preferred. Don't be shy! If you've never done open review before, JOSS is a great place to start. It's a really good way to learn by teaching (or learn by reading!) in a collaborative context. You can reply here or on the pre-review issue to volunteer :)edit: would love to have some infosec people on this one! even and especially if you are not in academia :)<a href="https://neuromatch.social/tags/OpenReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenReview</a> <a href="https://neuromatch.social/tags/PeerReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PeerReview</a> <a href="https://neuromatch.social/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a> <a href="https://neuromatch.social/tags/CodeReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CodeReview</a> <a href="https://neuromatch.social/tags/JOSS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#JOSS</a>

jonny (good kind)Still looking for a second reviewer for <a href="https://fosstodon.org/@pyOpenSci" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@pyOpenSci</a> Package: automata review: <a href="https://github.com/pyOpenSci/software-submission/issues/152" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/pyOpenSci/software-submission/issues/152</a> repo: <a href="https://github.com/caleb531/automata" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/caleb531/automata</a> description: A Python library for simulating finite automata, pushdown automata, and Turing machines.Open reviews are a great way to learn by teaching, see what other people are up to, and make software development a valued and creditable part of academic work. Anyone with familiarity with Python is welcome as a reviewer, experience in the topic domain is a bonus but not required. DM me or reply on the above issue, it's fun, i promise! :)edit: reviewer found! thank you <a href="https://neuromatch.social/@iris" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@iris</a> <3<a href="https://neuromatch.social/tags/PeerReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PeerReview</a> <a href="https://neuromatch.social/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a> <a href="https://neuromatch.social/tags/OpenReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenReview</a> <a href="https://neuromatch.social/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Python</a> <a href="https://neuromatch.social/tags/Automata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Automata</a> <a href="https://neuromatch.social/tags/TuringMachines" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TuringMachines</a> <a href="https://neuromatch.social/tags/CellularAutomata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CellularAutomata</a>

jonny (good kind)Putting a call out for <a href="https://fosstodon.org/@pyOpenSci" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@pyOpenSci</a> reviewers :)Package: <code>automata</code> - "A Python library for simulating finite automata, pushdown automata, and Turing machines." <a href="https://github.com/pyOpenSci/software-submission/issues/152" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/pyOpenSci/software-submission/issues/152</a>Looks like a good bit of fun (cellular automata are a recurring love of mine) - we would love to give people who haven't had a chance to review software a go here, but previous reviewers welcome too. You'll be taking on the role of a prospective user and colleague advising and trying to help make a package work as well as it can, reaching some minimum standard via checklist, raising issues and making suggestions as you read and run it.More on the review process: <a href="https://www.pyopensci.org/software-peer-review/how-to/reviewer-guide.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.pyopensci.org/software-peer-review/how-to/reviewer-guide.html</a>Reply here or DM me, (though my notifications are getting mauled rn so probably DM)<a href="https://neuromatch.social/tags/Automata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Automata</a> <a href="https://neuromatch.social/tags/CellularAutomata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CellularAutomata</a> <a href="https://neuromatch.social/tags/TuringMachines" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TuringMachines</a> <a href="https://neuromatch.social/tags/PyOpenSci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PyOpenSci</a> <a href="https://neuromatch.social/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a> <a href="https://neuromatch.social/tags/PeerReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PeerReview</a>

Spocko<a href="https://mastodon.social/@taylorlorenz" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@taylorlorenz</a> We never had problems with AOL! /sarcasm But seriously I worked with the developers of lots of software products. Before we would launch them I insisted we bring in a "normal" user & sometimes a former editor of a <a href="https://mastodon.online/tags/SoftwareReview" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoftwareReview</a> magazine. They found lots of problems because the developers made assumptions the "everybody knows." But the new users did NOT know. I said "The user can't read your mind" This was before 1000's of app store reviews. A bad review in a pub was devastating

Recent searches

Search options

Administered by:

Server stats: