Notes: Framework Agents Process

Submitted By brogerson
Words: 601
Pages: 3
Open Document
Details
Type: Improvement
Status:RESOLVED
Priority: Major
Resolution:Fixed
Affects Version/s:ManifoldCF 1.7
Fix Version/s:ManifoldCF 1.7
Component/s:Framework agents process
Labels:
None
Description
In some cases, documents that are indexed may be virtual children of those that are queued. A good example of this is RSS feeds where the data being indexed all comes from the feed.
In order to implement this, the following changes would be required:
(1) IProcessActivity.ingestDocument() has a variant which allows you to include a virtual child document identifier in addition to the main document identifier.
(2) IIncrementalIngester's addOrReplaceDocument receives TWO document keys – one for main (queued) document identifier, one for child virtual document identifier.
(3) IIncrementalIngester has two new methods: beginDocument() and endDocument(), both of which take a main (queued) document identifier as an argument.
(4) ingeststatus table has two additional columns: a state, and a child key.
(5) The flow is: at beginDocument() time, put all records relating to a document into a "processing" state. Documents that are seen have their state changed. Documents never encountered are deleted at the end.
(6) Incremental decisions not to update an output record STILL will require that the record be touched and its state set.
(7) DocumentIngest records for the entire set of children will be fetched when the document is queued.
(8) The getDocumentVersions() method must be modified to allow return of version strings for all children, although there can be "shortcuts" as well (where a single version string applies to all children.)
(9) The decision about whether to refetch a document is based on the returned version strings and on those fetched by the stuffer thread.
(10) Similarly, processDocuments() receives version strings for all virtual children.
(11) There is no need to actively reset the state of document records on restart; the current logic should be robust enough to be able to generate the required deletions.
(12) Deleting a document deletes ALL child virtual documents. This happens within the incremental ingester.
(13) Requeuing interval must be computed across all children, taking the minimum, since there's no requirement that an ingeststatus record exist for the parent.
(14) All other logic, including making sure only one agent operates on a url at a time, is the same.
(15) Interrupting the delete phase is
Show More

Related Documents: Notes: Framework Agents Process

My Virtual Child Report

Jannah Asaad 6/07/2015 MY Virtual Child Assignment 1 Birth- 4 years, 10 Months 1 . How does your baby’s eating, sleeping and motor development compare to the typical developmental patterns in the first 8 months? In order to determine how my baby, Yusuf, was doing at 8 months, the pediatrician administered a Bayley Scales of Infant Intelligence Test to decide if he was developing properly. The Bayley Scale of Infant Intelligence test is composed of three main components: a.) the Cognitive…

Words 4909 - Pages 20

Virtual Child Program Research Paper

1a. When I first started the Virtual Child program, I decided to name my child Pam. 1b. My child’s name was first introduced in the 16th century by the poet Sir Philip Sidney. The name Pam translates to the the greek word which means “all sweetness”. 1c. Pam is a significant name to me because my best friend’s mom’s name is Pam. His mom is very sweet and I am very grateful for everything she has done for me. 2a. The differences in emotionality are described as the seven dimensions of temperament…

Words 1679 - Pages 7

Essay about Virtual Reality and Neighborhood Association

neighborhood and the virtual world introduced the relationship from the child and the parents. The game Neighborhood is a significant symbol for the play, The Neighborhood can be representing in the both virtual and physical world. In the beginning the author introduces the time/place: right now in the virtual reality of a video game or suburbia. This method gives the reader a imagination space to think about the relationship between the virtual and the reality. However I think the virtual and the reality…

Words 1498 - Pages 6

Virtual Reality Essay

Abstract A Realistic Yet Virtual World shows readers the importance of a virtual reality through the eyes of a disabled student. Disabled students are able to use virtual reality to improve their education and learning abilities. By learning through a virtual reality, disabled students are able to learn without the potential humiliation from peers. Also, students are able to learn at their own pace rather than the teachers pace. I partook in My Virtual Child, which is a virtual reality. In the program…

Words 3210 - Pages 13

Argumentive Essay

Mollie Norton Mrs. Moody English 102-44 26 April 2012 Virtual Reality Most girls have had at least one boyfriend that would rather play his video games than answer her phone calls. Lucky for those boys, researchers are finding several advantages to the virtual world. The idea is becoming more attractive to more universities and to the workplace. Although this is becoming more accepted and widespread, there are also cons to living in a virtual world. Games like these affect the mind in more ways than…

Words 1034 - Pages 5

Virtual Reality Essay

Reality of Virtual Reality Christopher Shively Computer Literacy 103 Instructor Howard November 19, 2012 While many people believe virtual reality to be an entertainment feature, virtual reality is a feature that will one day shape many of our common industries in the world. From arts, communication, and architecture, to engineering, education, and the medical field, the advancements virtual reality is taking in these professions is vital to their progression in the future. Virtual reality can…

Words 1910 - Pages 8

Essay on Reality. What is it?

games, cell phones, IPods, the Internet, artificial intelligences and virtual ‘realities’ to name a few are developing at an exponential rate. In Nicholas Carr’s 2008 article “Is Google making us stupid” he analyzes both past and present how we as humans tend to adapt and acquire the qualities of the technologies we frequently use. With this recent phenomenon in the digital world, and the push to further develop and perfect virtual ‘realities’ the potential outcomes for this type of technology are essentially…

Words 1946 - Pages 8

Virtual Schoolbags: A Case Study

Understanding the point of view of a child is an important place to start when looking at an issue such as dealing with cultural diversity in a class. Malaguzzi reflects that a child is closely linked to their reality and they are unable to separate their experiences, relationships or feelings from this reality (Malaguzzi, 1993). In the situation when the child comes from a foreign country and have migrated to Australia, they have a very different reality than what many other children can relate…

Words 542 - Pages 3

The Effects Of Virtual Reality

As questionable as it may seem, virtual reality actually has numerous positive neurological effects, which is why it is viable to use in schools and companies. The world of virtual reality is growing, and technologists are discovering more ways to make users’ experiences more immersive. Current virtual reality technology uses the senses of sight, hearing, and touch to an extent, and possibly in the future, scent and taste will be implemented. The Japanese company, Vaqso, is working on a device which…

Words 1753 - Pages 8

Virtual Reality Essay

Virtual reality development has really slowed in recent years and recent progress is not exactly recent. This is more than likely due to public disappointment, further due to the high expectations created by media sensation. I must admit though, since I was a child Virtual Reality has transformed incredibly. Virtual Reality is a term that applies to computer simulated environments that can simulate physical presence in places in the real world, as well as imaginary worlds. Virtual Reality provides…

Words 1213 - Pages 5