AMANDA (Windows, OS X, Linux)
A Glossary of Special Terms
Term | Meaning |
---|---|
EPUB | A standardized format for digital books. |
FTP | FTP stands for File Transfer Protocol. It is a protocol used to transfer files from one computer to another via a wired or wireless network. |
Gantt chart | A type of bar chart used for project schedules, in which the tasks to be completed are shown as bars on the vertical axis, and time is shown on the horizontal axis, with the width of a given bar indicating the length of a given task. This facilitates planning by automating the tracking of milestone schedules and dependencies. |
GTD | GTD stands for Getting Things Done. It is a productivity method created by productivity consultant David Allen that allows users to focus on those tasks that should be addressed in a given context and at the right timescale of planning, from current activities to life-long goals. |
IP | IP stands for Intellectual Property, such as inventions and work products that are often patented or copyrighted. |
Linux | Linux is a family of open-source operating systems created by Linus Torvalds in 1991, serving as an alternative to the commercial ones. |
MTA | MTA stands for Materials Transfer Agreement—contracts that govern the transfer of research materials (e.g., DNA plasmids, cell lines) across institutions. |
MySQL | MySQL is an open-source database management system, consisting of a server back end that houses the data and a front end that allows users to query the database in very flexible ways. |
OCR | OCR stands for Optical Character Recognition—a process by which text is automatically recognized in an image, for example, converting a FAX or photo of a document into an editable text file. |
PDF stands for Portable Document Format, which serves as a standard format for many different types of devices and operating systems to be able to display (and sometimes edit) documents. | |
PMID | PMID stands for PubMed ID—the unique identifier used in the PubMed database to refer to published papers. |
SFTP | SFTP stands for SSH File Transfer Protocol but is often also referred to as Secure File Transfer Protocol. Its purpose is to transfer data over a network, similarly to FTP, but with added security (encryption). |
SSH | SSH stands for Secure Shell. This allows a remote user to connect to the operating system of their computer via a terminal-like interface. |
SSD | SSD stands for Solid State Drive. An SSD is a type of storage device for a computer that uses flash memory instead of a spinning disk, as in a typical hard drive. Compared with spinning hard drives, these are smaller, require less power, generate less heat, are less likely to break during routine use, and, crucially, enable vastly faster read and write speeds. |
TB | TB stands for Terabyte—a unit of measuring file size on a computer. One terabyte is equivalent to one thousand gigabytes, one million megabytes, or one trillion bytes. |
VNC | VNC stands for Virtual Network Computing—a desktop sharing system that transmits video signal and commands from one computer to another, allowing a user to interact with a remote computer the same way as if it were the computer they were currently using. |
VPN | VPN stands for Virtual Private Network. A virtual private network allows connections to internet-based resources with high security (encryption of data). |
WYSIWYG | WYSIWYG stands for What You See Is What You Get. This refers to applications where the output of text or other data being edited appears the same on-screen as it will when it is a finished project, such as a sheet of paper with formatted text (Microsoft Word and Scrivener are such, whereas LaTeX is not). |
Windows | Windows refers to the operating system Microsoft Windows. It is one of the most common operating systems in use today and is compatible with the vast majority of applications and hardware. |
XML | XML stands for Extensible Markup Language. Extensible Markup Language is a markup language used to encode documents such that they are readable by both humans and a variety of software. |
Although there is a huge variety of different types of scientific enterprises, most of them contain one or more activities that can be roughly subsumed by the conceptual progression shown in Figure 1 . This life cycle progresses from brainstorming and ideation through planning, execution of research, and then creation of work products. Each stage requires unique activities and tools, and it is crucial to establish a pipeline and best practices that enable the results of each phase to effectively facilitate the next phase. All of the recommendations given below are designed to support the following basic principles:
The Life Cycle of Research Activity
Various projects occupy different places along a typical timeline. The life cycle extends from creative ideation to gathering information, to formulating a plan, to the execution for the plan, and then to producing a work product such as a grant or paper based on the results. Many of these phases necessitate feedback to a prior phase, shown in thinner arrows (for example, information discovered during a literature search or attempts to formalize the work plan may require novel brainstorming). This diagram shows the product (end result) of each phase and typical tools used to accomplish them.
These basic principles can be used as the skeleton around which specific strategies and new software products can be deployed. Whenever possible, these can be implemented via external administration services (i.e., by a dedicated project manager or administrator inside the group), but this is not always compatible with budgetary constraints, in which case they can readily be deployed by each principal investigator. The PIs also have to decide whether they plan to suggest (or insist) that other people in the group also use these strategies, and perhaps monitor their execution. In our experience, it is most essential for anyone leading a complex project or several to adopt these methods (typically, a faculty member or senior staff scientist), whereas people tightly focused on one project and with limited concurrent tasks involving others (e.g., Ph.D. students) are not essential to move toward the entire system (although, for example, the backup systems should absolutely be ensured to be implemented among all knowledge workers in the group). The following are some of the methods that have proven most effective in our own experience.
Several key elements should be pillars of your Information Technology (IT) infrastructure ( Figure 2 ). You should be familiar enough with computer technology that you can implement these yourself, as it is rare for an institutional IT department to be able to offer this level of assistance. Your primary disk should be a large (currently, ∼2TB) SSD drive or, better, a disk card (such as the 2TB SSD NVMe PCIe) for fast access and minimal waiting time. Your computer should be so fast that you spend no time (except in the case of calculations or data processing) waiting for anything—your typing and mouse movement should be the rate-limiting step. If you find yourself waiting for windows or files to open, obtain a better machine.
Schematic of Data Flow and Storage
Three types of information: data (facts and datasets), action plans (schedules and to-do lists), and work product (documents) all interact with each other in defining a region of work space for a given research project. All of this should be hosted on a single PC (personal computer). It is accessed by a set of regular backups of several types, as well as by the user who can interact with raw files through the file system or with organized data through a variety of client applications that organize information, schedules, and email. See Table 2 for definitions of special terms.
One key element is backups—redundant copies of your data. Disks fail—it is not a question of whether your laptop or hard drive will die, but when. Storage space is inexpensive and researchers' time is precious: team members should not tolerate time lost due to computer snafus. The backup and accessibility system should be such that data are immediately recoverable following any sort of disaster; it only has to be set up once, and it only takes one disaster to realize the value of paranoia about data. This extends also to laboratory inventory systems—it is useful to keep (and back up) lists of significant equipment and reagents in the laboratory, in case they are needed for the insurance process in case of loss or damage.
The main drive should be big enough to keep all key information (not primary laboratory data, such as images or video) in one volume—this is to facilitate cloning. You should have an extra internal drive (which can be a regular disk) of the same size or bigger. Use something like Carbon Copy Cloner or SuperDuper to set up a nightly clone operation. When the main disk fails (e.g., the night before a big grant is due), boot from the clone and your exact, functioning system is ready to go. For Macs, another internal drive set up as a Time Machine enables keeping versions of files as they change. You should also have an external drive, which is likewise a Time Machine or a clone: you can quickly unplug it and take it with you, if the laboratory has to be evacuated (fire alarm or chemical emergency) or if something happens to your computer and you need to use one elsewhere. Set a calendar reminder once a month to check that the Time Machine is accessible and can be searched and that your clone is actually updated and bootable. A Passport-type portable drive is ideal when traveling to conferences: if something happens to the laptop, you can boot a fresh (or borrowed) machine from the portable drive and continue working. For people who routinely install software or operating system updates, I also recommend getting one disk that is a clone of the entire system and applications and then set it to nightly clone the data only , leaving the operating system files unchanged. This guarantees that you have a usable system with the latest data files (useful in case an update or a new piece of software renders the system unstable or unbootable and it overwrites the regular clone before you notice the problem). Consider off-site storage. CrashPlan Pro is a reasonable choice for backing up laboratory data to the cloud. One solution for a single person's digital content is to have two extra external hard drives. One gets a clone of your office computer, and one is a clone of your home computer, and then you swap—bring the office one home and the home one to your office. Update them regularly, and keep them swapped, so that should a disaster strike one location, all of the data are available. Finally, pay careful attention (via timed reminders) to how your laboratory machines and your people's machines are being backed up; a lot of young researchers, especially those who have not been through a disaster yet, do not make backups. One solution is to have a system like CrashPlan Pro installed on everyone's machines to do automatic backup.
Another key element is accessibility of information. Everyone should be working on files (i.e., Microsoft Word documents) that are inside a Dropbox or Box folder; whatever you are working on this month, the files should be inside a folder synchronized by one of these services. That way, if anything happens to your machine, you can access your files from anywhere in the world. It is critical that whatever service is chosen, it is one that s ynchronizes a local copy of the data that live on your local machine (not simply keeps files in the cloud) —that way, you have what you need even if the internet is down or connectivity is poor. Tools that help connect to your resources while on the road include a VPN (especially useful for secure connections while traveling), SFTP (to transfer files; turn on the SFTP, not FTP, service on your office machine), and Remote Desktop (or VNC). All of these exist for cell phone or tablet devices, as well as for laptops, enabling access to anything from anywhere. All files (including scans of paper documents) should be processed by OCR (optical character recognition) software to render their contents searchable. This can be done in batch (on a schedule), by Adobe Acrobat's OCR function, which can be pointed to an entire folder of PDFs, for example, and left to run overnight. The result, especially with Apple's Spotlight feature, is that one can easily retrieve information that might be written inside a scanned document.
Here, we focus on work product and the thought process, not management of the raw data as it emerges from equipment and experimental apparatus. However, mention should be made of electronic laboratory notebooks (ELNs), which are becoming an important aspect of research. ELNs are a rapidly developing field, because they face a number of challenges. A laboratory that abandons paper notebooks entirely has to provide computer interfaces anywhere in the facility where data might be generated; having screens, keyboards, and mice at every microscope or other apparatus station, for example, can be expensive, and it is not trivial to find an ergonomically equivalent digital substitute for writing things down in a notebook as ideas or data appear. On the other hand, keeping both paper notebooks for immediate recording, and ELNs for organized official storage, raises problems of wasted effort during the (perhaps incomplete) transfer of information from paper to the digital version. ELNs are also an essential tool to prevent loss of institutional knowledge as team members move up to independent positions. ELN usage will evolve over time as input devices improve and best practices are developed to minimize the overhead of entering meta-data. However, regardless of how primary data are acquired, the researcher will need specific strategies for transitioning experimental findings into research product in the context of a complex set of personal, institutional, and scientific goals and constraints.
The pipeline begins with ideas, which must be cultivated and then harnessed for subsequent implementation ( Altshuller, 1984 ). This step consists of two components: identifying salient new information and arranging it in a way that facilitates novel ideas, associations, hypotheses, and strategic plans for making impact.
For the first step, we suggest an automated weekly PubCrawler search, which allows Boolean searches of the literature. Good searches to save include ones focusing on specific keywords of interest, as well as names of specific people whose work one wants to follow. The resulting weekly email of new papers matching specific criteria complements manual searches done via ISI's Web of Science, Google Scholar, and PubMed. The papers of interest should be immediately imported into a reference manager, such as Endnote, along with useful Keywords and text in the Notes field of each one that will facilitate locating them later. Additional tools include DevonAgent and DevonSphere, which enable smart searches of web and local resources, respectively.
Brainstorming can take place on paper or digitally (see later discussion). We have noticed that the rate of influx of new ideas is increased by habituating to never losing a new idea. This can be accomplished by establishing a voicemail contact in your cell phone leading to your own office voicemail (which allows voice recordings of idea fragments while driving or on the road, hands-free) and/or setting up Endnote or a similar server-synchronized application to record (and ideally transcribe) notes. It has been our experience that the more one records ideas arising in a non-work setting, the more often they will pop up automatically. For notes or schematics written on paper during dedicated brainstorming, one tool that ensures that nothing is lost is an electronic pen. For example, the Livescribe products are well integrated with Evernote and ensure that no matter where you are, anything you write down becomes captured in a form accessible from anywhere and are safe no matter what happens to the original notebook in which they were written.
Enhancing scientific thought, creative brainstorming, and strategic planning is facilitated by the creation of mind maps: visual representations of spatial structure of links between concepts, or the mapping of planned activity onto goals of different timescales. There are many available mind map software packages, including MindNode; their goal is to enable one to quickly set down relationships between concepts with a minimum of time spent on formatting. Examples are shown in Figures 3 A and 3B. The process of creating these mind maps (which can then be put on one's website or discussed with the laboratory members) helps refine fuzzy thinking and clarifies the relationships between concepts or activities. Mind mappers are an excellent tool because their light, freeform nature allows unimpeded brainstorming and fluid changes of idea structure but at the same time forces one to explicitly test out specific arrangements of plans or ideas.
Mind Mapping
(A and B) The task of schematizing concepts and ideas spatially based on their hierarchical relationships with each other is a powerful technique for organizing the creative thought process. Examples include (A), which shows how the different projects in our laboratory relate to each other. Importantly, it can also reveal disbalances or gaps in coverage of specific topics, as well as help identify novel relationships between sub-projects by placing them on axes (B) or even identify novel hypotheses suggested by symmetry.
(C) Relationships between the central nervous system (CNS) and regeneration, cancer, and embryogenesis. The connecting lines in black show typical projects (relationships) already being pursued by our laboratory, and the lack of a project in the space between CNS and embryogenesis suggests a straightforward hypothesis and project to examine the role of the brain in embryonic patterning.
It is important to note that mind maps can serve a function beyond explicit organization. In a good mapped structure, one can look for symmetries (revealing relationships that are otherwise not obvious) between the concepts involved. An obvious geometric pattern with a missing link or node can help one think about what could possibly go there, and often identifies new relationships or items that had not been considered ( Figure 3 C), in much the same way that gaps in the periodic table of the elements helped identify novel elements.
The input and output of the feedback process between brainstorming and literature mining is information. Static information not only consists of the facts, images, documents, and other material needed to support a train of thought but also includes anything needed to support the various projects and activities. It should be accessible in three ways, as it will be active during all phases of the work cycle. Files should be arranged on your disk in a logical hierarchical structure appropriate to the work. Everything should also be searchable and indexed by Spotlight. Finally, some information should be stored as entries in a data management system, like Evernote or DevonThink, which have convenient client applications that make the data accessible from any device.
Notes in these systems should include useful lists and how-to's, including, for example:
Each note can have attachments, which include manuals, materials safety sheets, etc. DevonThink needs a little more setup but is more robust and also allows keeping the server on one's own machine (nothing gets uploaded to company servers, unlike with Evernote, which might be a factor for sensitive data). Scientific papers should be kept in a reference manager, whereas books (such as epub files and PDFs of books and manuscripts) can be stored in a Calibre library.
A special case of static information is email, including especially informative and/or actionable emails from team members, external collaborators, reviewers, and funders. Because the influx of email is ever-increasing, it is important to (1) establish a good infrastructure for its management and (2) establish policies for responding to emails and using them to facilitate research. The first step is to ensure that one only sees useful emails, by training a good Bayesian spam filter such as SpamSieve. We suggest a triage system in which, at specific times of day (so that it does not interfere with other work), the Inbox is checked and each email is (1) forwarded to someone better suited to handling it, (2) responded quickly for urgent things that need a simple answer, or (3) started as a Draft email for those that require a thoughtful reply. Once a day or a couple of times per week, when circumstances permit focused thought, the Draft folder should be revisited and those emails answered. We suggest a “0 Inbox” policy whereby at the end of a day, the Inbox is basically empty, with everything either delegated, answered, or set to answer later.
We also suggest creating subfolders in the main account (keeping them on the mail server, not local to a computer, so that they can be searched and accessed from anywhere) as follows:
Incoming emails belonging to those categories (for example, an email from an NIH program officer acknowledging a grant submission, a collaborator who emailed a plan of what they will do next, or someone who promised to answer a specific question) should be sorted from the Inbox to the relevant folder. Every couple of weeks (according to a calendar reminder), those folders should be checked, and those items that have since been dealt with can be saved to a Saved Messages folder archive, whereas those that remain can be Replied to as a reminder to prod the relevant person.
In addition, as most researchers now exchange a lot of information via email, the email trail preserves a record of relationships among colleagues and collaborators. It can be extremely useful, even years later, to be able to go back and see who said what to whom, what was the last conversation in a collaboration that stalled, who sent that special protocol or reagent and needs to be acknowledged, etc. It is imperative that you know where your email is being stored, by whom, and their policy on retention, storage space limits, search, backup, etc. Most university IT departments keep a mail server with limited storage space and will delete your old emails (even more so if you move institutions). One way to keep a permanent record with complete control is with an application called MailSteward Pro. This is a front-end client for a freely available MySQL server, which can run on any machine in your laboratory. It will import your mail and store unlimited quantities indefinitely. Unlike a mail server, this is a real database system and is not as susceptible to data corruption or loss as many other methods.
A suggested strategy is as follows. Keep every single email, sent and received. Every month (set a timed reminder), have MailSteward Pro import them into the MySQL database. Once a year, prune them from the mail server (or let IT do it on their own schedule). This allows rapid search (and then reply) from inside a mail client for anything that is less than one year old (most searches), but anything older can be found in the very versatile MailStewardPro Boolean search function. Over time, in addition to finding specific emails, this allows some informative data mining. Results of searches via MailStewardPro can be imported into Excel to, for example, identify the people with whom you most frequently communicate or make histograms of the frequency of specific keywords as a function of time throughout your career.
With ideas, mind maps, and the necessary information in hand, one can consider what aspects of the current operations plan can be changed to incorporate plans for new, impactful activity.
A very useful strategy involves breaking down everything according to the timescales of decision-making, such as in the Getting Things Done (GTD) philosophy ( Figure 4 ) ( Allen, 2015 ). Activities range from immediate (daily) tasks to intermediate goals all the way to career-scale (or life-long) mission statements. As with mind maps, being explicit about these categories not only force one to think hard about important aspects of their work, but also facilitate the transmission of this information to others on the team. The different categories are to be revisited and revised at different rates, according to their position on the hierarchy. This enables you to make sure that effort and resources are being spent according to priorities.
Scales of Activity Planning
Activities should be assigned to a level of planning with a temporal scale, based on how often the goals of that level get re-evaluated. This ranges from core values, which can span an entire career or lifetime, all the way to tactics that guide day-to-day activities. Each level should be re-evaluated at a reasonable time frame to ensure that its goals are still consistent with the bigger picture of the level(s) above it and to help re-define the plans for the levels below it.
We also strongly recommend a yearly personal scientific retreat. This is not meant to be a vacation to “forget about work” but rather an opportunity for freedom from everyday minutiae to revisit, evaluate, and potentially revise future activity (priorities, action items) for the next few years. Every few years, take more time to re-map even higher levels on the pyramid hierarchy; consider what the group has been doing—do you like the intellectual space your group now occupies? Are your efforts having the kind of impact you realistically want to make? A formal diagram helps clarify the conceptual vision and identify gaps and opportunities. Once a correct level of activity has been identified, it is time to plan specific activities.
A very good tool for this purpose, which enables hierarchical storage of tasks and subtasks and their scheduling, is OmniFocus ( Figure 5 ). OmniFocus also enables inclusion of files (or links to files or links to Evernote notes of information) together with each Action. It additionally allows each action to be marked as “Done” once it is complete, providing not only a current action plan but a history of every past activity. Another interesting aspect is the fact that one can link individual actions with specific contexts: visualizing the database from the perspective of contexts enables efficient focus of attention on those tasks that are relevant in a specific scenario. OmniFocus allows setting reminders for specific actions and can be used for adding a time component to the activity.
Project Planning
This figure shows a screenshot of the OmniFocus application, illustrating the nested hierarchy of projects and sub-projects, arranged into larger groups.
The best way to manage time relative to activity (and to manage the people responsible for each activity) is to construct Gantt charts ( Figure 6 ), which can be used to plan out project timelines and help keep grant and contract deliverables on time. A critical feature is that it makes dependencies explicit, so that it is clear which items have to be solved/done before something else can be accomplished. Gantt charts are essential for complex, multi-person, and/or multi-step projects with strict deadlines (such as grant deliverables and progress reports). Software such as OmniPlanner can also be used to link resources (equipment, consumables, living material, etc.) with specific actions and timelines. Updating and evaluation of a Gantt chart for a specific project should take place on a time frame appropriate to the length of the next immediate phase; weekly or biweekly is typical.
Timeline Planning
This figure shows a screenshot of a typical Gantt chart, in OmniPlan software, illustrating the timelines of different project steps, their dependencies, and specific milestones (such as a due date for a site visit or grant submission). Note that Gantt software automatically moves the end date for each item if its subtasks' timing changes, enabling one to see a dynamically correct up-to-date temporal map of the project that adjusts for the real-world contingencies of research.
In addition to the comprehensive work plan in OmniFocus or similar, it is helpful to use a Calendar (which synchronizes to a server, such as Microsoft Office calendar with Exchange server). For yourself, make a task every day called “Monday tasks,” etc., which contains all the individual things to be accomplished (which do not warrant their own calendar reminder). First thing in the morning, one can take a look at the day's tasks to see what needs to be done. Whatever does not get done that day is to be copied onto another day's tasks. For each of the people on your team, make a timed reminder (weekly, for example, for those with whom you meet once a week) containing the immediate next steps for them to do and the next thing they are supposed to produce for your meeting. Have it with you when you meet, and give them a copy, updating the next occurrence as needed based on what was decided at the meeting to do next. This scheme makes it easy for you to remember precisely what needs to be covered in the discussion, serves as a record of the project and what you walked about with whom at any given day (which can be consulted years later, to reconstruct events if needed), and is useful to synchronize everyone on the same page (if the team member gets a copy of it after the meeting).
Writing, to disseminate results and analysis, is a central activity for scientists. One of the OmniFocus library's sections should contain lists of upcoming grants to write, primary papers that are being worked on, and reviews/hypothesis papers planned. Microsoft Word is the most popular tool for writing papers—its major advantage is compatibility with others, for collaborative manuscripts (its Track Changes feature is also very well implemented, enabling collaboration as a master document is passed from one co-author to another). But Scrivener should be seriously considered—it is an excellent tool that facilitates complex projects and documents because it enables WYSIWYG text editing in the context of a hierarchical structure, which allows you to simultaneously work on a detailed piece of text while seeing the whole outline of the project ( Figure 7 ).
Writing Complex Materials
This figure shows a screenshot from the Scrivener software. The panel on the left facilitates logical and hierarchical organization of a complex writing project (by showing where in the overall structure any given text would fit), while the editing pane on the right allows the user to focus on writing a specific subsection without having to scroll through (but still being able to see) the major categories within which it must fit.
It is critical to learn to use a reference manager—there are numerous ones, including, for example, Endnote, which will make it much easier to collaborate with others on papers with many citations. One specific tip to make collaboration easier is to ask all of the co-authors to set the reference manager to use PMID Accession Number in the temporary citations in the text instead of the arbitrary record number it uses by default. That way, a document can have its bibliography formatted by any of the co-authors even if they have completely different libraries. Although some prefer collaborative editing of a Google Doc file, we have found a “master document” system useful, in which a file is passed around among collaborators by email but only one can make (Tracked) edits at a time (i.e., one person has the master doc and everyone makes edits on top of that).
One task most scientists regularly undertake is writing reviews of a specific subfield (or Whitepapers). It is often difficult, when one has an assignment to write, to remember all of the important papers that were seen in the last few years that bear on the topic. One method to remedy this is to keep standing document files, one for each topic that one might plausibly want to cover and update them regularly. Whenever a good paper is found, immediately enter it into the reference manager (with good keywords) and put a sentence or two about its main point (with the citation) into the relevant document. Whenever you decide to write the review, you will already have a file with the necessary material that only remains to be organized, allowing you to focus on conceptual integration and not combing through literature.
The life cycle of research can be viewed through the lens of the tools used at different stages. First there are the conceptual ideas; many are interconnected, and a mind mapper is used to flesh out the structure of ideas, topics, and concepts; make it explicit; and share it within the team and with external collaborators. Then there is the knowledge—facts, data, documents, protocols, pieces of information that relate to the various concepts. Kept in a combination of Endnote (for papers), Evernote (for information fragments and lists), and file system files (for documents), everything is linked and cross-referenced to facilitate the projects. Activities are action items, based on the mind map, of what to do, who is doing what, and for which purpose/grant. OmniFocus stores the subtasks within tasks within goals for the PI and everyone in the laboratory. During meetings with team members, these lists and calendar entries are used to synchronize objectives with everyone and keep the activity optimized toward the next step goals. The product—discovery and synthesis—is embodied in publications via a word processor and reference manager. A calendar structure is used to manage the trajectory from idea to publication or grant.
The tools are currently good enough to enable individual components in this pipeline. Because new tools are continuously developed and improved, we recommend a yearly overview and analysis of how well the tools are working (e.g., which component of the management plan takes the most time or is the most difficult to make invisible relative to the actual thinking and writing), coupled to a web search for new software and updated versions of existing programs within each of the categories discussed earlier.
A major opportunity exists for software companies in the creation of integrated new tools that provide all the tools in a single integrated system. In future years, a single platform will surely appear that will enable the user to visualize the same research structure from the perspective of an idea mind map, a schedule, a list of action items, or a knowledge system to be queried. Subsequent development may even include Artificial Intelligence tools for knowledge mining, to help the researcher extract novel relationships among the content. These will also need to dovetail with ELN platforms, to enable a more seamless integration of project management with primary data. These may eventually become part of the suite of tools being developed for improving larger group dynamics (e.g., Microsoft Teams). One challenge in such endeavors is ensuring the compatibility of formats and management procedures across groups and collaborators, which can be mitigated by explicitly discussing choice of software and process, at the beginning of any serious collaboration.
Regardless of the specific software products used, a researcher needs to put systems in place for managing information, plans, schedules, and work products. These digital objects need to be maximally accessible and backed up, to optimize productivity. A core principle is to have these systems be so robust and lightweight as to serve as an “external brain” ( Menary, 2010 )—to maximize creativity and deep thought by making sure all the details are recorded and available when needed. Although the above discussion focused on the needs of a single researcher (perhaps running a team), future work will address the unique needs of collaborative projects with more lateral interactions by significant numbers of participants.
We thank Joshua Finkelstein for helpful comments on a draft of the manuscript. M.L. gratefully acknowledges support by an Allen Discovery Center award from the Paul G. Allen Frontiers Group (12171) and the Barton Family Foundation.
Start free trial
What do you need to know to succeed at project management? Everything! While there’s some truth to that joke, this answer can be narrowed down by looking at the project management knowledge areas as defined in the Project Management Body of Knowledge (PMBOK), a book by the Project Management Institute (PMI), which compiles the fundamental concepts of project management .
The project management knowledge areas can be simply defined as the key aspects of project management that should be overseen by project managers so they can plan, schedule, track and deliver projects successfully with the help of the project team and project stakeholders.
Each of these project management knowledge areas needs to be managed throughout the five project life cycle phases, which are project initiation, project planning, project execution, monitoring and controlling, and project closing. These are the chronological phases that every project goes through, also referred to as project management process groups in PMI’s PMBOK.
Get your free
Use this free Project Plan Template for Word to manage your projects better.
The PMBOK knowledge areas take place during any one of these process groups. You can think of the process groups as horizontal, while the knowledge areas are vertical. The knowledge areas are the core technical subject matter, which is necessary for effective project management.
Here’s an overview of each of the 10 knowledge areas of project management, including a brief description of the key project management documents needed to control each of them. All of these project documents are part of the project management plan which includes information about all knowledge areas of project management.
Project integration management can be simply defined as the framework that allows project managers to coordinate tasks, resources, stakeholders, changes and project variables. Project managers can use different tools to make sure there are solid project integration management practices in place. For example, the project management plan is important for project integration because it works as a roadmap for the project to reach a successful end. Once created, the project plan is approved by stakeholders and/or sponsors before it’s monitored and tracked by the project management team.
Project management software, like ProjectManager , is ideal for project integration management because it’s an online platform that project managers can use to create a project plan, oversee project management knowledge areas and collaborate with their teams online. Choose between online Gantt charts, kanban boards, project calendars and other project management views to plan, schedule and track your projects. ProjectManager also has project reporting features that allow project managers to create project reports they can share with project stakeholders to keep them informed.
The project integration area also includes the directing and managing of the project work, which is the production of its deliverables. This process is monitored, analyzed and reported on to identify and control any changes or problems that might occur.
Also, any change control will be carried out. That might require request forms, approval from stakeholders and/or sponsors or another admin. This area is also part of the project closure at the end of the project.
Project scope management is one of the most important project management knowledge areas. It consists of managing your project scope, which refers to the work that needs to be executed in a project. To manage your project scope , you’ll need to build a project scope management plan, a document where you’ll define what will be done in your project.
To start building your scope management plan , begin by writing a scope statement. This statement is anything from a sentence to a bulleted list that’s comprehensive to reduce major project risks. Another part of this area is a work breakdown structure (WBS), which is a graphic breakdown of project work.
Validate scope during the project, which means making sure that the deliverables are being approved regularly by the sponsor or stakeholder. This occurs during the monitoring and controlling process groups and is about accepting the deliverables, not the specs laid out during planning.
The scope statement is likely going to change over the course of the project to control the scope, such as if a project falls behind schedule.
Project time management involves estimating your project duration, creating a project schedule and tracking the project team’s progress to ensure the project is completed on time. To do so, the first thing to do is to define your project scope to identify the tasks that should go into your project schedule.
Those project tasks are then put in an order that makes sense, and any dependencies between them are noted. These dependencies are then determined to be either finish-to-start (FS), finish-to-finish (FF), start-to-start (SS) or start-to-finish (SF). This is mostly for larger projects.
With the tasks now sequenced, the project resources required for each must be estimated and assigned. The duration of each task is also determined at this point. All of this leads to a schedule by first determining the critical path and float for each task. You should use project management tools like Gantt charts , kanban boards or project calendars to place the tasks on a timeline, and then work on resource leveling to balance resource usage. Once the project schedule is made, plans to control the schedule are necessary. Earned value management is performed regularly to make sure that the actual plan is proceeding as planned.
This project management knowledge area involves estimating project costs to create a project budget . To do so, you’ll need to use cost-estimating tools and techniques to make sure that the funds cover the project expenses and are being monitored regularly to keep stakeholders or sponsors informed.
As with other project management knowledge areas, the cost management plan is the document where you’ll explain the method to establish the budget, which includes how and if it will change and what procedures will be used to control it. Each project task will have to be estimated for cost , which means including all resources such as labor, materials, equipment and anything else needed to complete the task.
A project can come in on time and within budget, but if the quality isn’t up to standard, then the project is a failure. This means that quality management is one of the most critical project management knowledge areas. Your project management plan should include a quality management plan section that specifies the quality control and quality assurance guidelines for your project.
Therefore, to control quality, the deliverables must be inspected to ensure that the standards outlined in the quality management plan are being met.
The project team is your most important resource, so it’s crucial to assemble the best team and make sure they’re happy. But also you need to track their performance to ensure that the project is progressing as planned. A human resource management plan identifies the roles and requirements for those positions, as well as how they fit into the overall project structure.
After you’ve determined the project roles , it’s time to fill those positions and acquire a project team. This can be done in-house by drawing from other departments in the organization, getting new hires or a combination of both. The team needs development, possibly training and other things that’ll make them viable for the project.
Managing the project team is an ongoing responsibility of the project manager. The team is monitored to make sure they’re working productively and that there are no internal conflicts, so everyone is satisfied.
All knowledge areas of project management are important, but communication management might be paramount as it informs every aspect of the project. Communications inform the team and stakeholders, therefore the need to plan communications management is a critical step in any project.
It’s at this point that the dissemination of communications is determined, including how it’s done and with what frequency. Target who needs what and when. Also, note how communications will occur when issues such as changes arise in the project.
Manage the communications when the project is executed to make sure it runs as planned. This also involves controlling communications by reviewing their effectiveness regularly and adjusting as needed.
Risk management plans identify how the risks will be itemized, categorized and prioritized. This involves identifying risks that might occur during the execution of the project by making a risk register .
Perform qualitative risk analysis after the biggest risks have been identified and classified by likelihood and impact. Then prioritize them. Then perform quantitative analysis according to their impact on the project, such as its budget, schedule, etc.
Now you’ll need to plan risk responses . If those risks in fact become issues, then a response needs to have been written in advance, with an owner who can make sure the risk is properly identified and handled. Controlling risk involves regularly reviewing the risk register and crossing off those risks that are no longer going to impact the project.
This project management knowledge area deals with outside procurement, which is part of most projects, such as hiring subcontractors. This will impact on the budget and schedule. Procurement management planning starts by identifying the outside needs of the project and how those contractors will be involved.
Now conduct those procurements by hiring the contractors, which includes a statement of work , terms of reference, request for proposals and choosing a vendor. You’ll want to control the procurement process by managing and monitoring, and then closing the contracts once the work has been done to everyone’s satisfaction.
The stakeholders must be happy, as the project has been created for their needs. Therefore, they must be actively managed like any other part of the project. To start, identify the stakeholders through stakeholder analysis and find out what concerns they have. It’s not always easy, but it’s a crucial part of starting any project.
Now plan stakeholder management , which means listing each stakeholder and prioritizing their concerns and how they might impact the project. This will lead to managing stakeholders’ expectations to make sure their needs are met and that you’re in communication with them.
Throughout the project, you’ll want to control stakeholder engagement by determining if the stakeholders’ needs are being addressed. If not, figure out what changes need to be made to either satisfy those needs or adjust the expectations.
Now that we have a better understanding of what the project management knowledge areas are, let’s explore the differences between them and other similar project management concepts.
We’ve discussed the project management knowledge areas and they’re related to the project management process groups , but they’re not the same thing. The project management knowledge areas are guidelines for the technical side of running a project.
The project management process groups, on the other hand, work with the project management knowledge areas to run the project. The project management process groups are the five main phases of a project: initiating, planning, executing, monitoring and controlling and closing.
Again, the project management knowledge areas are how the project is managed. They offer various methods to get work planned, managed, tracked, etc. Project management skills , like process groups, work together with the knowledge area. For example, many of the project management skills are technical, or hard, skills. These include those key knowledge area disciplines from planning to risk and everything in between.
But project management skills go beyond technical skills. These are called soft skills and include things such as being a good leader, having strong communication skills and facilitating collaboration. While these skills are often harder to teach, they’re no less important to the success of the project. Project managers need to be problem-solvers, manage their time wisely, be organized and have critical thinking skills or all the hard skills in the world won’t deliver a successful project.
Project management knowledge areas need powerful tools to be implemented throughout the project’s life cycle. ProjectManager is award-winning project management software that has the features you need to plan, manage and track your project in real time. Our task management, risk management and resource management features give project managers and their teams the tools they need to deliver their projects on time and within budget.
Every project has a diverse team working together for the same goals, but not necessarily using the same tools. When you’re applying all the project management knowledge areas, you need diversity. That’s why our software gives project managers robust online Gantt charts to plan and schedule their projects while teams can choose between task lists and kanban boards. Stakeholders, who don’t need to get into the weeds of the project, can view progress on calendars. All project views update simultaneously in real time so everyone is on the same page.
The project management knowledge areas require monitoring and control to work. You can’t expect the executed project to align with the project plan; you need to review and revise as needed. That is why our software has a variety of tracking tools. You can get a high-level overview of the project with our real-time dashboard , which automatically tracks time, cost and more with easy-to-read graphs and charts. Also, there’s no time-consuming setup required as with other software. We also have secure timesheets to monitor your team’s progress on their tasks and a color-coded workload chart that makes it easy to balance workload and keep teams productive and working at capacity.
Another tool to track progress and performance is our customizable reports . You can get more data than from the dashboard by generating a report in only a couple of keystrokes. Get reports on project or portfolio status, workload, timesheets, variance and much more. All reports can be filtered to focus on only what you want to see. Then they can be shared in a variety of formats to keep stakeholders informed.
Project management knowledge areas bring a project to life, but life can be chaotic and complex, which is why project managers need a tool to help manage all these moving parts of a project. ProjectManager is online project management software with real-time dashboards and Gantt charts to monitor the project accurately throughout its many phases. See how it can help you manage your projects by taking this free 30-day trial.
Start planning your projects.
Project managers: skills and traits that make good ones great.
Guiding a tech project from start to finish entails staying on top of seemingly endless details, decisions and data (and sometimes, detours). From making sure progress is achieved on time and on budget to keeping stakeholders updated to ensuring teams work together smoothly—and much more—project managers are constantly keeping multiple balls in the air, and if they drop one, a project can quickly go off the rails.
Even though theirs is not a simple job, the very best project managers can make the jobs of their teammates much easier. Below, 20 members of Forbes Technology Council discuss the skills and traits that elevate a good project manager to a great one and why these characteristics are so impactful.
High-quality communication, in all its forms, is one skill effective project managers must have and improve on. Communication must be objective, timely and complete, whether written or verbal. Meetings with team members, one-on-one discussions, presentations, announcements, technical reports and emails are all instances of essential communication resources for a successful project manager. - David William Silva , Algemetric
A great project manager will embrace their inner toddler, asking “why?” a lot. If someone wants to add a feature, asking “why?” will help determine if it is in or out of scope. If someone is pushing a deadline, asking “why?” will help determine if deploying more resources or swapping dependencies will alleviate the challenge, or if indeed a deadline change is needed. - Patti Mikula , Hackworks Inc .
Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?
In project management, effective leadership and problem solving are the most important skills. A project manager must not only inspire and guide their own team, but also inspire confidence through their conviction in the client’s vision. Possessing a problem-solving mindset is crucial to navigating uncertainties and unexpected challenges, which is at the core of every successful project. - Shraddha Thanawala , Remiges Technologies P Ltd
Tech skills may dazzle, but teams thrive on humanity. Project managers with emotional intelligence have a galvanizing effect on their teams and the organization. They don’t just crack whips louder; they inspire ownership and camaraderie. Teams unleash discretionary effort when they are led not by authority but by authenticity. - HK Bain , Digitech Systems, LLC
It’s important to understand the difference between a program manager and a project manager. A program manager’s role is more strategic, and their work is tied to meeting business and organizational goals. On the other hand, a project manager is really incentivized to focus on the delivery of a project. Both roles are necessary and have similar guiding principles, but the differences are significant. - Scott Sumner , Medidata - Dassault Systémes
A key characteristic of a highly effective project manager is the ability to anticipate issues and plan proactively for the future. This foresight enables them to mitigate risks and keep projects on track. Execution is the key KPI. - Saif Sultan , Volos Portfolio Solutions, Inc .
Highly effective project managers embrace an agile mindset. This means delivering clear communication of business objectives while allowing teams the space to determine how to achieve those goals. This is how project managers can encourage creative problem solving among their teams, allowing them to iterate and adapt as needed, which ultimately leads to fulfilled teams. - Mark Lorion , Tempo Software
Project managers should provide unbiased updates to management, cross-functional teams and executive leadership on a weekly basis. Highlight what is working well and call out what needs management’s attention. An ideal project manager leverages the technical leadership available to them to resolve issues in a scalable way. - Ravi Bandlamudi , AtoB
Undoubtedly, a crucial trait of a great project manager is the ability and willingness to dive deep. This doesn’t come down to domain-specific skills or technical capability; rather, it’s the application of analytical thinking to resolve issues and uncover opportunities. It requires good instincts to know when to do a deep dive, which items need attention to be resolved and which representative set of successful items to observe to know what “good” looks like. - Elliott Cordo , Data Futures
Inevitably, projects will encounter roadblocks. Project managers need resilience to push through challenges. A strong project manager builds on trust and clear communication with the team so that they can navigate challenges effectively, adapt quickly and support each other to keep the project on track. - Ruhbir Singh , Tatvic
An exceptional project manager is skilled in communication, adept at conveying clear information and actively listens. They effectively tailor the project’s vision to diverse audiences. The ability to unite various teams across the organization to work toward a shared goal and ensure each member understands their role in achieving the overarching vision of the project is crucial. - Rahil Shah , Zomentum (Pactora Inc.)
In my experience, one characteristic of a highly effective project manager is “empathetic precision"—that is, the ability to relate to the needs of team members while maintaining a relentless focus on zero variation from the budgeted cost and time. Empathy allows them to build strong relationships, foster collaboration and address challenges effectively, all while ensuring the project is completed without deviation from the roadmap. - Sandy Hardikar , Network Science Ltd.
A project manager has so much to do. They must empower and uplift the team, make complicated things simple so they can be understood by everyone, get quick approvals if needed, set and monitor KPIs, maintain a strong project rhythm, and more. All of this requires constant, rigorous focus. - Rosalba Carandente , Baker Hughes
Given its linear job description, the project manager role seems straightforward, but there are definitely qualities that set a great PM apart from a mediocre one. One such quality is accountability—a feeling of ownership of a project that goes beyond the tasks required to deliver it. When a PM becomes the “mini CEO” of a project, they use high-level critical thinking to resolve challenges before they happen. - Antony Demekhin , Tuney
When a project—for example, an AI solution—has a team whose members include both technical and business users, the project manager should make sure that the business users are heard and understood rapidly at every step and that the final product delivered reflects the business users’ feedback about specifics, such as the data used, variables, KPIs and so on. - Zehra Cataltepe , TAZI AI
The best project managers that we have hired were extremely detail-oriented. This is crucial when managing a product, because there are typically many moving parts. Staying organized and paying attention to details ensures products are delivered on time and within budget. - Trent Hoerr , FPFX Tech
A highly effective skill in project management is clear and concise communication, which is crucial for team coordination and stakeholder alignment. I’d also say that I’ve seen proficiency in sales complement this by enabling effective leadership, persuasive negotiations and client relationship building, all of which contribute to project success. - Jeremy Vaughan , Start Left Security
The best CEOs come from project management. Great PMs bridge business needs and technology by speaking both languages and establishing strong rapport with both groups. The best PM is the company’s demo god, has the top five customers’ numbers in their phone, and takes engineering out for a beer once a quarter. - Ari Kahn , Bridgeline Digital
Amazing project managers take success very personally. Driven to make positive contributions, they see each project as a chance to strive toward self-actualization and reach their full potential. As a result, they push themselves to take full ownership and minimize any chance of failure. A successfully completed project is often a testament to the project manager’s desire for personal fulfillment. - Hamid Farooqui , Sogolytics
In my experience, one crucial characteristic of a highly effective project manager is curiosity. A curious project manager continuously seeks new insights, solutions and approaches, fostering innovation and adaptability, which are key to project success. - Patrick Emmons , DragonSpears, Inc.
Why do managers go home every night, with a full briefcase, feeling badly about what they didn’t get done that day, instead of feeling good about what they did get done?
This is the question that started the research program that eventually led to the establishment of Effective Managers TM , an organization dedicated to helping managers be more effective.
Too often, organizations can inadvertently put roadblocks in the way of managers – sometimes the very systems that are put in place to help managers actually hinder them in unintended ways. Opinions abound on how to improve performance, but no published research exists that quantifies manager effectiveness and the drivers that reinforce or constrain effectiveness.
The Telfer School of Management, University of Ottawa, and Effective Managers TM partnered to undertake ground breaking research investigating managerial effectiveness in the workplace. This research explored new aspects of the management literature.
The research study closed at the end of 2013. Nearly 200 managers, representing nearly 2,000 manager-subordinate relationships from eight organizations (private sector, not for profit and government) participated in the Effective Managers TM research project. The results are now being written up for management sciences journals.
Managers report they are operating at just over 55% effectiveness.
They are attending meetings they shouldn’t attend, reading emails they shouldn’t have to read, fighting jurisdictional battles they shouldn’t have to fight, and duplicating work also assigned elsewhere.
The bottom line is that, through research, we have an understanding of the actual effectiveness of managers. On average managers feel they are operating at just 55% effectiveness. That is an ineffectiveness ratio of over 2 days a week! Managers identified that they spend just over 20% of their time doing work that is not part of their job. In addition, they spend nearly 25% of their time doing work that could (we would say should) be delegated to an administrative support position.
Here are some of the key findings:
You don’t have to wait for the published journals. Participation in the Manager Effectiveness TM Survey is now available to any organization, in English or French, at a very reasonable price point. A 94-question confidential survey has been developed to gather data directly from managers, who can log on to a secure web site to provide their direct input on these measures. Traditional employee surveys require all employers to participate. With this survey, a CEO can get the results with an investment of 20 – 30 minutes of each manager’s time.
Accountability measure.
The research shows that Accountability is very highly correlated with manager effectiveness. Accountability is at the heart of managerial leadership. It is important that employees have a clear understanding of what they are being held accountable for and how their outcomes will contribute to the success of their organization. Accountability is also correlated with team and organization effectiveness.
Accountability has two dimensions:
To understand the disconnect, and how organizations have gone so wrong, it is important to realize that Accountability actually has two dimensions. First, what is the clarity of the accountability and authority that has been delegated to managers? For instance, if I am a manager, am I clear about not only what my manager is holding me accountable for, but also the authority I have for doing my work?
We call this the Clarity of Accountability dimension. As an organizational measure, this means thinking about how well the organization can translate accountability for output from the strategic plan, through the CEO, down to each individual manager in the organization. This measure correlates highly with a managers’ perceived self-effectiveness.
The second dimension of accountability is Felt Accountability . This concept has been written about in management sciences literature. It refers to the degree to which an individual feels he or she is accountable. It could be related to being accountable to a manager for work, or it could be other things that are not real accountabilities, but feel like accountabilities. Examples of Felt Accountability include:
In all of these examples, these are not real accountabilities because managers are not held to account by a specified other that has the authority to hold them to account. Nevertheless, they can be quite distracting if the managers of managers do not take them into account when setting the context for doing work. Felt Accountability , interestingly, scores much higher than Clarity of Accountability .
This reinforces the perspective that people care about their work and want to do well.
The question is not whether managers feel accountable. They do.
The question is whether they feel accountable for the right things. This is the manager’s job – to be clear about those things for which they will hold their subordinates to account.
A series of seven measures are correlated with Accountability in organizations. These are important to understand, as they provide the insight into root causes that can constrain or improve accountability in the workplace.
Workflow – The extent to which managers perceive work flowing smoothly across the organization. This measure assesses the extent to which managers perceive work flowing smoothly across the organization. If managers don’t understand their accountability and authority with respect to peers in other parts of the organization, they will gravitate towards “I’ll just do it myself – it’s easier”. Work tends to happen within distinct organizational units. If work does not flow smoothly across the organization, it can lead to misunderstandings and duplication of effort, both of which are counter to Manager Effectiveness.
Fewer than 40% of managers surveyed felt that work flowed smoothly across their organizations.
Organizational Learning – The extent to which individuals in the organization learn from others, share, experiment and transfer knowledge. This measure describes the relationship between effective organizational learning with other organizational factors, and its direct impact on the effectiveness of managers. Organizations continually face challenges in managing their knowledge assets. To the extent that organizations are better at managing and transferring knowledge, one would expect that managers would be more effective. The data reinforces these concepts with high correlations between Organizational Learning and Clarity of Accountability, and a high correlation with Manager Effectiveness directly. High degrees of organizational learning were correlated with high accountability.
Role Conflict – The degree of conflict that managers experience in their day to day work. This measure assesses the degree of conflict that managers experience in their day to day work. One would expect that in organizations where there is a lack of clarity of accountability, that there would be increased role conflict. The data did show this to be the case, as these two measures are very highly negatively correlated. Role conflict was high; almost half of managers agreed with statements that described conflict situations
Corporate Systems – Providing support to managers for doing their work. Organizations have in place organization-wide systems that are intended to support employees in their work. These systems also have organizational objectives. For example, Finance must provide certain information to the Board and to the CEO in a timely way for the effective management and governance of the organization. Finance also provides support to employees, such as provision of expenditures against budgets, processing expense accounts, and so on. What often happens is that the systems that have been put in place, or should be put in place to support management don’t get the attention they deserve from the CEO and executive management. The balance between serving the organization and supporting the manager can become skewed, often to the point where managers see the support system as an overall burden instead of a support. Managers almost universally feel that corporate systems do not provide the appropriate amount of support, and that they are skewed toward the organization as a whole rather than designed to support managers in their work.
Manager’s Manager Capability – The extent to which managers feel that their manager is capable. The immediate question one might ask is: What is the role of managers of managers? The CEO manages Vice Presidents, Vice Presidents manage Directors, and so on. In each of these cases, the manager of the managers would seem to have an important role in terms of the delegation of accountability to their subordinate managers. If a manager is not capable at doing her / his job, the subordinate manager is less likely to receive the clarity required to be effective at his / her job. Managers, in general, feel that their own managers are capable. Although there is room for improvement, this is positive. The managerial chain in organizations is critical to effective delegation. And as we have seen earlier in this report, clarity of accountability has significant room for improvement. If a manager is not capable at doing her / his job, the direct report manager is less likely to receive the Clarity of Accountability required to be effective at his / her job. Similarly, if the manager does not perceive that their manager is capable, they will not have the degree of Felt Accountability necessary for effectiveness. High manager’s manager capability was correlated to high accountability.
Interdependence – How much managers depend on other managers in parts of the organization to do their work. Interdependence is a measure that explores the reliance of individuals on others, in other parts of the organization, for success in their work. Interdependence in and of itself isn’t a positive or a negative factor – it is an indicator of a certain state in organizations. Some organizations, by their nature, require a greater independence of their managerial workforce for production and delivery of products and services. High interdependence indicates that managers rely highly on managers in other parts of the organization for success in their work..
Team and Organizational Effectiveness – The effectiveness of both teams and the organization as a whole.
As research findings are published, you will be able to connect to them on this page. In the meantime, register for our eNewsletter for a monthly update including our most insightful content.
+1 647 283 1096 About Dwight LinkedIn Twitter
Sign up to join the Effective Managers™ eNewsletter Group!
You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.
All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .
Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.
Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.
Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.
Original Submission Date Received: .
Find support for a specific problem in the support section of our website.
Please let us know what you think of our products and services.
Visit our dedicated information section to learn more about MDPI.
A domain-specific lexicon for improving emergency management in gas pipeline networks through knowledge fusing.
2.1. data collection and processing, 2.1.1. standard collection and terminology extraction, 2.1.2. risk inventory collection and processing, 2.1.3. domain data collection and processing, 2.2. candidate word set construction, 2.3. domain-specific bert fine tuning, 2.4. lexicon expansion, 3.1. candidate words, 3.2. expanded lexicon, 3.3. impact analysis, 4. discussion, 5. conclusions, author contributions, institutional review board statement, informed consent statement, data availability statement, conflicts of interest.
Click here to enlarge figure
Acronym | Description | Owner | Link |
---|---|---|---|
PHMSA | Data about federally regulated and state-regulated natural gas pipelines, hazardous liquid pipelines, and liquefied natural gas (LNG) plants | Department of Transportation Pipeline and Hazardous Materials Safety Administration | on 20 May 2024) |
eMARS | Reports of chemical accidents and near misses | MAHB (the Major Accident Hazards Bureau) | on 17 February 2024) |
OSHA | Accident investigation information is provided, including textual descriptions of the accident and details regarding the injuries and fatalities which occurred | OSHA (Occupational Safety and Health Administration) | (accessed on 17 May 2024) |
Standards Name | Terminology |
---|---|
Standard for safety inspection of urban gas facilities [ ] | City gas facilities, safety inspection, city gate station, valve pit, regulator station, compressed natural gas |
Technical specification for trenchless rehabilitation and replacement engineering of city gas pipe [ ] | Slip lining, “fold-and-form” lining, deformed and reformed, static pipe bursting, cured-in-place pipe, compound tubular material, no-dig rehabilitation and replacement |
Technical specification for leak detection of the city gas piping system [ ] | City gas piping system, leak detection, pipeline subsidiary facilities, piping system process equipment, sensitivity, maximum permissible error |
Technical specification for the control of external corrosion on underground gas pipelines of steel in area of cities and towns [ ] | Corrosion, corrosion rate, corrosion control, corrosion potential, free corrosion potential, coating, holiday, electrical isolation, electrical conduct, stray current, interference |
Source of Risk | Location |
---|---|
Liquefied petroleum gas storage tanks, cylinder depots, vaporization chambers, LPG transmission lines, compressed natural gas processing units, gas cylinder trucks, liquefied natural gas processing units, LNG tanker trucks, and devices for natural gas metering and pressure regulation, storage tanks, transmission pipelines | Production areas of gas supply companies, areas with pressure regulation and metering devices along pipeline routes |
Infrastructure or extreme weather | Areas with gas supply equipment, transportation routes |
Earthmoving activities | Trenches |
Electrical equipment | Sites using electrical equipment and lines |
Hoses for loading and unloading LPG, CNG, LNG | Areas for loading and unloading LPG, CNG, LNG |
Dictionary Domain | Data | Main Method | Main Model | Domain Weight | Application Purpose | Word Count |
---|---|---|---|---|---|---|
Accident Disaster [ ] | Emergency Standards (98 documents) | TF-IDF | Word2Vec | None | Classify accidents and natural disasters | 1767 |
Public Safety [ ] | Web Crawling | PMI | Manual intervention | Yes | Public safety event opinion recognition | 328 |
Electricity [ ] | Baidu Encyclopedia | XGBoost | Word2Vec | None | Named entity recognition in electricity | / |
Commodity Trading [ ] | Book Content | TF-IDF | Word2Vec | None | Keyword extraction | 1066 |
Education [ ] | Weibo Crawling | R-SOPMI | Skip-gram | None | Sentiment classification | 39,138 |
Tourism Education [ ] | Scenic Spot Introduction | TF-IDF | Manual intervention | None | Understand the historical connotation of scenic spots | 542 |
This Paper | Gas Standards (589 Documents) | Improved TF-IDF | BERT | Yes | Emergency management | 4646 |
Candidate Words | TF-IDF Values | Candidate Words | TF-IDF Values | Candidate Words | TF-IDF Values |
---|---|---|---|---|---|
Construction | 0.87825 | Valve | 0.60116 | Rescue | 0.55138 |
Operation | 0.77903 | Engineering | 0.58870 | Organization | 0.55049 |
Liquefied Petroleum Gas | 0.77732 | Excavation | 0.58689 | Department | 0.54887 |
Pipeline | 0.76862 | Excavator | 0.58360 | Plan | 0.53793 |
Production | 0.75127 | Emergency | 0.58144 | Construction Site | 0.53704 |
Natural Gas | 0.74487 | Inspection | 0.57918 | Safety | 0.53486 |
Gas Pipe | 0.72926 | Deflagration | 0.56927 | Disposal | 0.53117 |
Pipeline | 0.71646 | Management | 0.56493 | Connection | 0.49896 |
Installation | 0.61668 | Explosion | 0.55686 | Pressure | 0.45071 |
Underground | 0.60599 | Construction | 0.55518 | Gas | 0.42280 |
Input Case | Output Cases | Similarity |
---|---|---|
Enshi City Cuijiaba Town “7.20” Sichuan Gas Eastward Natural Gas Leakage Explosion Incident | “7.2” PetroChina Gas Pipeline Explosion Accident in Qianxinan Prefecture, Guizhou | 95% |
Gas Leakage Caused by Landslide in Dazhou, Sichuan | 90% | |
Gas Leakage in Enshi, 7 People Injured to Varying Degrees | 87% | |
“7.30” Natural Gas Explosion Accident in Century Garden Community, Changchun City, Jilin | 85% | |
Shiyan City, Hubei, Gas Explosion Accident Caused 26 Deaths and 138 Injuries | 82% |
Example Word | Top_10 Similar Words | Similarity | Example Word | Top_10 Similar Words | Similarity | Example Word | Top_10 Similar Words | Similarity |
---|---|---|---|---|---|---|---|---|
Third-party construction | Construction personnel | 0.794868 | Pipeline corrosion | Metal corrosion | 0.822075 | Violation operation | Violation operation | 0.971644 |
Engineering construction | 0.789968 | Soil corrosion | 0.814401 | Illegal operation | 0.905846 | |||
Earthwork | 0.776132 | Corrosion depth | 0.790442 | Operational error | 0.857111 | |||
Construction site | 0.771524 | Anti-corrosion | 0.780696 | Mistaken operation | 0.845006 | |||
Construction supervision | 0.770464 | Alternating corrosion | 0.776138 | Wrong operation | 0.828287 | |||
Building construction | 0.764414 | Corrosion resistance | 0.775762 | Wrong operation | 0.812226 | |||
Construction party | 0.762031 | Corrosive | 0.775109 | Violation behavior | 0.806560 | |||
Construction unit | 0.760292 | Pipeline worker | 0.770510 | Mistaken action | 0.800422 | |||
Construction technology | 0.759121 | Plastic pipeline | 0.762916 | Operational procedures | 0.779057 | |||
Engineering pipeline | 0.740861 | Corrosion-resistant | 0.761888 | Violation of regulations | 0.778593 |
Example Word | Candidate Words | Example Word | Candidate Words | Example Word | Candidate Words |
---|---|---|---|---|---|
Construction | 0.98185 | Valve | 0.85366 | Rescue | 0.87627 |
Operation | 0.93430 | Engineering | 0.96161 | Organization | 0.88904 |
Liquefied Petroleum Gas | 0.81294 | Excavation | 0.52760 | Department | 0.85826 |
Pipeline | 0.83681 | Excavator | 0.23351 | Plan | 0.80443 |
Production | 0.94400 | Emergency | 1.17261 | Construction Site | 0.39046 |
Natural Gas | 0.97668 | Inspection | 0.91783 | Safety | 0.99905 |
Gas Pipe | 0.88607 | Deflagration | 0.42427 | Disposal | 0.90271 |
Pipeline | 1.09717 | Management | 0.85444 | Connection | 0.93137 |
Installation | 1.01146 | Explosion | 0.77161 | Pressure | 1.02946 |
Underground | 0.78267 | Construction | 1.01764 | Gas | 1.04425 |
Causes | Number |
---|---|
Third-party construction | 01 |
Violation of construction regulations | 02 |
Improper installation | 03 |
Improper operation | 04 |
Improper disposal | 05 |
Unauthorized operation | 06 |
Blind excavation | 07 |
Long-term lack of maintenance | 08 |
Equipment failure | 09 |
Pipeline valve leakage | 10 |
Pipeline leakage | 11 |
Pipeline weld cracking | 12 |
Pipeline rupture | 13 |
Pipeline detachment | 14 |
Pipeline aging | 15 |
Pipeline corrosion | 16 |
Loose interface connection | 17 |
Natural forces | 18 |
Facility compression | 19 |
Vehicle collision | 20 |
Illegal transportation | 21 |
Gas theft | 22 |
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
Zhao, X.; Hu, Y.; Qin, T.; Wan, W.; Wang, Y. A Domain-Specific Lexicon for Improving Emergency Management in Gas Pipeline Networks through Knowledge Fusing. Appl. Sci. 2024 , 14 , 8094. https://doi.org/10.3390/app14178094
Zhao X, Hu Y, Qin T, Wan W, Wang Y. A Domain-Specific Lexicon for Improving Emergency Management in Gas Pipeline Networks through Knowledge Fusing. Applied Sciences . 2024; 14(17):8094. https://doi.org/10.3390/app14178094
Zhao, Xinghao, Yanzhu Hu, Tingxin Qin, Wang Wan, and Yudi Wang. 2024. "A Domain-Specific Lexicon for Improving Emergency Management in Gas Pipeline Networks through Knowledge Fusing" Applied Sciences 14, no. 17: 8094. https://doi.org/10.3390/app14178094
Article access statistics, further information, mdpi initiatives, follow mdpi.
Subscribe to receive issue release notifications and newsletters from MDPI journals
COMMENTS
The adage that project management is both science and art is true. Project manager (PM) effectiveness hinges on the "right" combination of experience, knowledge, leadership, and soft skills. Team effectiveness is an outgrowth of PM effectiveness. How well a PM creates and develops his or her team, and leads the project to successful execution, directly relates to this "right" combination ...
For more information on Research Project Management at MUN, and to access project management resources, such as tools/templates/guidance material, that will aid in the implementation of project management process es discussed in this guide, please visit Memorial's Research Project Management website at . https://research-tools.mun.ca/rpm/
Studies have shown that project managers are responsible for the successful management of various projects. Increasingly, this success depends on the project manager being a knowledge worker (KW)—i.e., possessing and utilizing both "hard" and "soft" skills/competencies to manage assigned projects. Nonetheless, there has not been enough studies on what these competencies are ...
Despite the existence of systematic literature reviews focused on examining the factors contributing to project success, there remains a scarcity of reviews addressing the relationship between the project managers' competencies and project success. To fill this gap in the literature, this review aimed to evaluate peer-reviewed articles, published between 2010 and 2022, and analyze the impact ...
10 Essential Project Management Skills
Managing Ideas, People, and Projects
Literature review. The research addressing project management effectiveness in project-oriented business organizations includes the following themes: (1) organizational structures, (2) technical competency, i.e. project management tools and methods, (3) leadership ability, and (4) the characteristics of an effective project manager.
Project managers, working on complex, critical, and costly projects require relevant knowledge to do their jobs. KM ensures the availability of such knowledge. Current state knowledge reflects the status and progress of active projects and processes. Process knowledge reflects the way a process is performed. KM addresses both current state and ...
2.3 Project managers' breadth of experience and project complexity. Complexity is a fundamental feature of any project. Apart from its intuitive direct detrimental effect on performance (Griffin, 1997), project complexity also has an indirect impact by moderating the effects of many other project characteristics.For instance, project complexity has been found to moderate the effect of team ...
The research addressing project management effectiveness in project-oriented business organizations includes the following themes: (1) organizational structures, (2) technical competency, i.e. project management tools and methods, (3) leadership ability, and (4) the characteristics of an effective project manager.
2 3. From our synthesis of the interviews, we have developed eight project leadership survival skills: 1. Anticipating - being prepared for what could knock the project off course next. 2. Judgement and decision-making - making timely decisions with incomplete information. 3.
Studies on the behavioral traits of project managers in relation to project success suggest that this is an under researched area in project management research (Turner & Muller, 2005; Khan et al, 2014). However, empirical evidence from the field of general management suggests a definite link between the two constructs (Kirkpatrick & Locke, 1991).
Successful project managers continually demonstrate a core set of behaviors that enable them to effectively lead project teams. This paper examines an exploratory study attempting to distinguish the core behaviors--as determined by senior managers--of effective project managers. In doing so, it defines the study's six interview questions that 41 senior managers were asked to answer in relation ...
The 10 Project Management Knowledge Areas - (PMBOK)
20 Essential Skills Every Project Manager Should Have
The research results showed four key effectiveness enablers of the knowledge management processes: a learning organization, an organizational strategy, an organizational structure and an ...
Project Managers: Skills And Traits That Make Good Ones ...
Abstract and Figures. It is a significant challenge to define and achieve success in information systems project management, given the high number and diversity of involved stakeholders and ...
Creativity as a topic in project management - A scoping ...
The bottom line is that, through research, we have an understanding of the actual effectiveness of managers. On average managers feel they are operating at just 55% effectiveness. That is an ineffectiveness ratio of over 2 days a week! Managers identified that they spend just over 20% of their time doing work that is not part of their job.
Emergencies in gas pipeline networks can lead to significant loss of life and property, necessitating extensive professional knowledge for effective response and management. Effective emergency response depends on specialized knowledge, which can be captured efficiently through domain-specific lexicons. The goal of this research is to develop a specialized lexicon that integrates domain ...