Text Processing & Knowledge Discovery System for Digest Preparing and Decision Making

3. Information system , supporting decision making , with embedded adaptation function Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva User (problem situation) KNOWLEDGE BASE Documents text processing & loading OUTPUT DATA FOR QUERIES PROCESSED METADATA: THESAURUS THEMATIC C L ASSIFIER SUBJECT CLASSIFIERS NAVIGATOR TEXT DATA BASE Queries processing DATA BASE RECORDS STATSTICAL DATA ONE TERM FREQUENCIES COUNTING & NORMALISATI O N ATTRIBUTES NAMES & VALUES DETECTION TWO TERMS FREQUENCIES COUNTING & COVARI A NCE MATRIX FORMATION MAXIMUM SPANNING TREE DEVELOPMENT & EXPLICATION AS NAVIGATOR FORMAL CONTEXT TABLE FORMING @ FILLING FORMAL CONCEPTS& RULES DISCOVERING

4. Three Steps of MST Construction Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva TWO TERMS FREQUENCIES COUNTING & COVARI A NCE MATRIX FORMATION M aximum Spanning Tree ONE TERM FREQUENCIES COUNTING & NORMALISATI O N MAXIMUM SPANNING TREE DEVELOPMENT

5. The Construction of Maximum Spanning Tree Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva The Term Connectedness Graphs The Pairs of Terms Frequencies Matrix

6. Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva The Construction of Maximum Spanning Tree Maximum Spanning Tree Maximum Spanning Tree Matrix

7. Dynamic picture is formed as maximum spanning tree for graph, is representing covariance matrix for word/lemmas or concepts pairs. MST serves as dynamically changing thesaurus or semantic net for query navigation. Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva

8. Above the each word there is a sign one of two kinds: leaf or branch. The word designated by the leaf sign has not any connections down the tree. The words designed by branch sign permit further navigation along the route. Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva The user begins retrieval session with browsing dictionary with word frequencies and choosing the word to be included in the query.

9. An example of MST for thematic class “Production reconstruction” Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva

14. STAGES OF DB SCHEMA EXTRACTION FROM SET OF TEXTS Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva Formal Concept Analysis Context Concepts The problem situation data base schema

15. The problem situation description in data base Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva Document Tokenization - Morphological anlaysis Semantical analysis Syntactical analysis User interface forms for data entering Data base records Data base loading

16. C1:=( main management board) Concepts of the situation “Reconstruction” f1:=main management board, f2:=building, f3:=cold rolling shop, f4:=reconstruction, f5:=blast furnace Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva O 5 O 4 O 3 O 2 O 1 f5 f4 f3 f2 f1 С ontext    O 5    O 4    O 3 O 2 O 1 C 2 f5 f4 f3 f2 f1 C2:= ( main management board, reconstruction , blast furnace )     O 5 O 4 O 3 O 2 O 1 C 5 f5 f4 f3 f2 f1 C5:=( main management board, cold rolling shop, reconstruction , blast furnace )   O 5 O 4 O 3   O 2   O 1 C 3 f5 f4 f3 f2 f1 C3:=( main management board, cold rolling shop) O 5     O 4 O 3 O 2 O 1 C 6 f5 f4 f3 f2 f1 C6:=( main management board, building, reconstruction , blast furnace )  O 5  O 4  O 3  O 2  O 1 C 1 f5 f4 f3 f2 f1 O 5 O 4 O 3    O 2    O 1 C 4 f5 f4 f3 f2 f1 C4:=( main management board, building, cold rolling shop) O 5 × × O 4 O 3 × × O 2 × × O 1 C 7 f5 f4 f3 f2 f1 C7:=( main management board, building)

17. The Hasse diagram of concept lattice Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva C 1 C 4 C 3 C 2 C1:=( main management board) C2:= ( main management board, reconstruction , blast furnace ) C3:=( main management board, cold rolling shop) C4:=( main management board, building, cold rolling shop) C5:=( main management board, cold rolling shop, reconstruction , blast furnace ) C7:=( main management board, building) C6:=( main management board, building, reconstruction , blast furnace ) C 6 C 5 C 7

18. Digest of situation Plekhanov Russian Academy of Economics D octor V. Romanov, student E. Pantileeva User (problem situation ) Document collection Official structure Object name Actions Region Action’s effect Time Main Management board Blast furnace reconstruction Lipetsk city Scrap metal utilization melioration IV quarters of xxx-year Main Management board Cold rolling shop building Magnitogorsk city Steel production increment I half xxx-year Mounting &building department Blast furnace Putting into operation Lipetsk city Equipment mounted II quarters of xxx-year