2012 03 01_bioinformatics_ii_les1

99

Upload: wvcrieki

Post on 20-Aug-2015

393 views

Category:

Education


0 download

TRANSCRIPT

FBW01-03-2012

Wim Van Criekinge

RELOADED2

Inhoud

09:00-11:00 (2s) (A: Theorie) Coup. Links., CL.A1057

16:00-19:00 (2s) (B: Practicum) Coup. Links., CL.PC-C

Cursus: 40 €

• do 16 februari: Geen Les

• do 23 februari: Geen Les

• do 1 maart: Recap Bioinformatics I, RDBMS, (Bio)SQL

• do 8 maart: Web Application Developent (PHP)

• do 15 maart: MyGenBank

• do 22 maart: Genome Browsers

• do 29 maart: Galaxy

• do 5 april: Geen Les

• do 12 april: Geen Les

• do 19 april: Datamining (Tim De Meyer)

• do 26 april: Textmining (Maté Ongenaert)

• do 3 mei: Systems Biology (Bart Deplancke)

• do 10 mei: Les 10 (projectvoorstelling)

Les 1

• Bioinformatics I Revisited in 5 slides• Why bother making databases ?• DataBases

– FF• *.txt• Indexed version

– Relational (RDBMS)• Access, MySQL, PostGRES, Oracle

– OO (OODBMS)• AceDB, ObjectStore

– Hierarchical• XML

– Frame based system • Eg. DAML+OIL

– Hybrid systems

4 3 2 1 0

A brief history of time (BYA)

Origin oflife

Origin ofeukaryotes insects

Fungi/animalPlant/animal

Earliestfossils

BYA

Rat versus mouse RBP

Rat versus bacteriallipocalin

Sander-Schneider

• HSSP: homology derived secondary structure

• About the Syllabus / CD

In tegenstelling tot Bioinformatica I is het minder de bedoeling om een overzicht te geven van de verschillende (sub)domeinen in de bioinformatica. Bioinformatica II (Reloaded) schetst een zo accuraat mogelijk beeld van de huidige stand van zaken in het bioinformatica onderzoek. Hiervoor wordt er dieper ingegaan in het gebruik van relationele databeheersystemen en hun praktische implementaties, vandaar de term “Reloaded”. Deze methodologie laat toe om grote heterogene datasets, typische voor biologische experimenten die meer en meer op (meta)genoomschaal worden uitgevoerd, te beheersen en gestructureerd op te slaan voor verdere (statistische) analyse. Het tweede van de cursus focust op de verschillende methodieken uit machine learning en kunstmatige intelligentie en hoe deze kunnnen ingeschakelt worden om data, via het gebruik van databanken,  om te zetten tot nieuwe verifieerbare gefundeerde hypothesis die zo hopelijk leiden tot nieuwe kennis.

Usage of the databases

Annotation searches - Search for keywords, authors, features

Usage of the databases

Annotation searches - Search for keywords, authors, features

What is the protein sequence for human insulin? How does the 3D structure of calmodulin look like? What is the genetic location of the cystic fibrosis gene? List all intron sequences in rat.

Usage of the databases

Annotation searches - Search for keywords, authors, features

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Is there any known protein sequence that is similar to x? Is this gene known in any other species? Has someone already cloned this sequence?

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Do my protein sequence contain any known motif (that can give me a clue about the function)?

Which known sequences contain this motif? Is any part of my nucleotide sequence recognized

by a transcriptional factor? List all known start, splice and stop signals in my

genomic sequence.

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Predictions - Using the databases as knowledge databases

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Predictions - Using the databases as knowledge databases

What may the structure of my protein be? Secondary structure prediction.Modelling by homology.

What is the gene structure of my genomic sequence? Which parts of my protein have a high antigenicity?

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Predictions - Using the databases as knowledge databases

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Predictions - Using the databases as knowledge databases

Comparisons

Usage of the databases

Annotation searches - Search for keywords, authors, features

Homology (similarity) searches - Search for similar sequences

Pattern searches - Search for occurrences of patterns

Predictions - Using the databases as knowledge databases

Comparisons

Gene families Phylogenetic trees

Les 1

• Bioinformatics I Revisited in 5 slides• Why bother making databases ?• DataBases

– FF• *.txt• Indexed version

– Relational (RDBMS)• Access, MySQL, PostGRES, Oracle

– OO (OODBMS)• AceDB, ObjectStore

– Hierarchical• XML

– Frame based system • Eg. DAML+OIL

– Hybrid systems

GenBank Format

LOCUS LISOD 756 bp DNA BCT 30-JUN-1993DEFINITION L.ivanovii sod gene for superoxide dismutase.ACCESSION X64011.1 GI:37619753NID g44010KEYWORDS sod gene; superoxide dismutase.SOURCE Listeria ivanovii.ORGANISM Listeria ivanovii Eubacteria; Firmicutes; Low G+C gram-positive bacteria; Bacillaceae; Listeria.REFERENCE 1 (bases 1 to 756) AUTHORS Haas,A. and Goebel,W. TITLE Cloning of a superoxide dismutase gene from Listeria ivanovii by functional complementation in Escherichia coli and characterization of the gene product JOURNAL Mol. Gen. Genet. 231 (2), 313-322 (1992) MEDLINE 92140371REFERENCE 2 (bases 1 to 756) AUTHORS Kreft,J. TITLE Direct Submission JOURNAL Submitted (21-APR-1992) J. Kreft, Institut f. Mikrobiologie, Universitaet Wuerzburg, Biozentrum Am Hubland, 8700 Wuerzburg, FRG

FEATURES Location/Qualifiers source 1..756 /organism="Listeria ivanovii" /strain="ATCC 19119" /db_xref="taxon:1638" RBS 95..100 /gene="sod" gene 95..746 /gene="sod" CDS 109..717 /gene="sod" /EC_number="1.15.1.1" /codon_start=1 /product="superoxide dismutase" /db_xref="PID:g44011" /db_xref="SWISS-PROT:P28763" /transl_table=11 /translation="MTYELPKLPYTYDALEPNFDKETMEIHYTKHHNIYVTKL NEAVSGHAELASKPGEELVANLDSVPEEIRGAVRNHGGGHANHTLFWSSLSPN GGGAPTGNLKAAIESEFGTFDEFKEKFNAAAAARFGSGWAWLVVNNGKLEIVS TANQDSPLSEGKTPVLGLDVWEHAYYLKFQNRRPEYIDTFWNVINWDERNKRF DAAK" terminator 723..746 /gene="sod"

Example of location descriptors

Location Description

476 Points to a single base in the presented sequence

340..565 Points to a continuous range of bases bounded by and including the starting and ending bases

<345..500 The exact lower boundary point of a feature is unknown.

(102.110) Indicates that the exact location is unknown but that it is one of the bases between bases 102 and 110.

(23.45)..600 Specifies that the starting point is one of the bases between bases 23 and 45, inclusive, and the end base 600

123^124 Points to a site between bases 123 and 124

145^177 Points to a site anywhere between bases 145 and 177

J00193:hladr Points to a feature whose location is described in another entry: the feature labeled 'hladr' in the entry (in this database) with primary accession 'J00193'

BASE COUNT 247 a 136 c 151 g 222 tORIGIN

1 cgttatttaa ggtgttacat agttctatgg aaatagggtc tatacctttc gccttacaat

61 gtaatttctt ttcacataaa taataaacaa tccgaggagg aatttttaat gacttacgaa

121 ttaccaaaat taccttatac ttatgatgct ttggagccga attttgataa agaaacaatg

181 gaaattcact atacaaagca ccacaatatt tatgtaacaa aactaaatga agcagtctca

241 ggacacgcag aacttgcaag taaacctggg gaagaattag ttgctaatct agatagcgtt

301 cctgaagaaa ttcgtggcgc agtacgtaac cacggtggtg gacatgctaa ccatacttta

361 ttctggtcta gtcttagccc aaatggtggt ggtgctccaa ctggtaactt aaaagcagca

421 atcgaaagcg aattcggcac atttgatgaa ttcaaagaaa aattcaatgc ggcagctgcg

481 gctcgttttg gttcaggatg ggcatggcta gtagtgaaca atggtaaact agaaattgtt

541 tccactgcta accaagattc tccacttagc gaaggtaaaa ctccagttct tggcttagat

601 gtttgggaac atgcttatta tcttaaattc caaaaccgtc gtcctgaata cattgacaca

661 ttttggaatg taattaactg ggatgaacga aataaacgct ttgacgcagc aaaataatta

721 tcgaaaggct cacttaggtg ggtcttttta tttcta

//

EMBL formatID LISOD standard; DNA; PRO; 756 BP. IDentificationXXAC X64011; S78972; Accession (Axxxxx, Afxxxxxx), GUIDXXNI g44010 Nucleotide Identifier --> x.xXXDT 28-APR-1992 (Rel. 31, Created) DaTeDT 30-JUN-1993 (Rel. 36, Last updated, Version 6)XXDE L.ivanovii sod gene for superoxide dismutase DEscriptionXX.KW sod gene; superoxide dismutase. KeyWordXXOS Listeria ivanovii Organism SpeciesOC Eubacteria; Firmicutes; Low G+C gram-positive bacteria; Bacillaceae;OC Listeria. Organism ClassificationXXRN [1]RA Haas A., Goebel W.; ReferenceRT "Cloning of a superoxide dismutase gene from Listeria ivanovii by RT functional complementation in Escherichia coli and RT characterization of the gene product."; RL Mol. Gen. Genet. 231:313-322(1992).XX

Example of a SwissProt entry ID TNFA_HUMAN STANDARD; PRT; 233 AA. IDentification AC P01375; ACcession DT 21-JUL-1986 (REL. 01, CREATED) DaTe DT 21-JUL-1986 (REL. 01, LAST SEQUENCE UPDATE) DT 15-JUL-1998 (REL. 36, LAST ANNOTATION UPDATE) DE TUMOR NECROSIS FACTOR PRECURSOR (TNF-ALPHA) (CACHECTIN). GN TNFA. Gene name OS HOMO SAPIENS (HUMAN). Organism Species OC EUKARYOTA; METAZOA; CHORDATA; VERTEBRATA; TETRAPODA; MAMMALIA; OC EUTHERIA; PRIMATES. Organism Classification RN [1] Reference RP SEQUENCE FROM N.A. RX MEDLINE; 87217060. RA NEDOSPASOV S.A., SHAKHOV A.N., TURETSKAYA R.L., METT V.A., RA AZIZOV M.M., GEORGIEV G.P., KOROBKO V.G., DOBRYNIN V.N., RA FILIPPOV S.A., BYSTROV N.S., BOLDYREVA E.F., CHUVPILO S.A., RA CHUMAKOV A.M., SHINGAROVA L.N., OVCHINNIKOV Y.A.; RL COLD SPRING HARB. SYMP. QUANT. BIOL. 51:611-624(1986). RN [2] RP SEQUENCE FROM N.A. RX MEDLINE; 85086244. RA PENNICA D., NEDWIN G.E., HAYFLICK J.S., SEEBURG P.H., DERYNCK R., RA PALLADINO M.A., KOHR W.J., AGGARWAL B.B., GOEDDEL D.V.; RL NATURE 312:724-729(1984). ...

CC -!- FUNCTION: CYTOKINE WITH A WIDE VARIETY OF FUNCTIONS: IT CAN CC CAUSE CYTOLYSIS OF CERTAIN TUMOR CELL LINES, IT IS IMPLICATED CC IN THE INDUCTION OF CACHEXIA, IT IS A POTENT PYROGEN CAUSING CC FEVER BY DIRECT ACTION OR BY STIMULATION OF IL-1 SECRETION, IT CC CAN STIMULATE CELL PROLIFERATION & INDUCE CELL DIFFERENTIATION CC UNDER CERTAIN CONDITIONS. Comments CC -!- SUBUNIT: HOMOTRIMER. CC -!- SUBCELLULAR LOCATION: TYPE II MEMBRANE PROTEIN. ALSO EXISTS AS CC AN EXTRACELLULAR SOLUBLE FORM. CC -!- PTM: THE SOLUBLE FORM DERIVES FROM THE MEMBRANE FORM BY CC PROTEOLYTIC PROCESSING. CC -!- DISEASE: CACHEXIA ACCOMPANIES A VARIETY OF DISEASES, INCLUDING CC CANCER AND INFECTION, AND IS CHARACTERIZED BY GENERAL ILL CC HEALTH AND MALNUTRITION. CC -!- SIMILARITY: BELONGS TO THE TUMOR NECROSIS FACTOR FAMILY. DR EMBL; X02910; G37210; -. Database Cross-references DR EMBL; M16441; G339741; -. DR EMBL; X01394; G37220; -. DR EMBL; M10988; G339738; -. DR EMBL; M26331; G339764; -. DR EMBL; Z15026; G37212; -. DR PIR; B23784; QWHUN. DR PIR; A44189; A44189. DR PDB; 1TNF; 15-JAN-91. DR PDB; 2TUN; 31-JAN-94.

KW CYTOKINE; CYTOTOXIN; TRANSMEMBRANE; GLYCOPROTEIN; SIGNAL-ANCHOR; KW MYRISTYLATION; 3D-STRUCTURE. KeyWord FT PROPEP 1 76 Feature Table FT CHAIN 77 233 TUMOR NECROSIS FACTOR. FT TRANSMEM 36 56 SIGNAL-ANCHOR (TYPE-II PROTEIN). FT LIPID 19 19 MYRISTATE. FT LIPID 20 20 MYRISTATE. FT DISULFID 145 177 FT MUTAGEN 105 105 L->S: LOW ACTIVITY. FT MUTAGEN 108 108 R->W: BIOLOGICALLY INACTIVE. FT MUTAGEN 112 112 L->F: BIOLOGICALLY INACTIVE. FT MUTAGEN 162 162 S->F: BIOLOGICALLY INACTIVE. FT MUTAGEN 167 167 V->A,D: BIOLOGICALLY INACTIVE. FT MUTAGEN 222 222 E->K: BIOLOGICALLY INACTIVE. FT CONFLICT 63 63 F -> S (IN REF. 5). FT STRAND 89 93 FT TURN 99 100 FT TURN 109 110 FT STRAND 112 113 FT TURN 115 116 FT STRAND 118 119 FT STRAND 124 125

FT STRAND 130 143 FT STRAND 152 159 FT STRAND 166 170 FT STRAND 173 174 FT TURN 183 184 FT STRAND 189 202 FT TURN 204 205 FT STRAND 207 212 FT HELIX 215 217 FT STRAND 218 218 FT STRAND 227 232 SQ SEQUENCE 233 AA; 25644 MW; 666D7069 CRC32; MSTESMIRDV ELAEEALPKK TGGPQGSRRC LFLSLFSFLI VAGATTLFCL LHFGVIGPQR EEFPRDLSLI SPLAQAVRSS SRTPSDKPVA HVVANPQAEG QLQWLNRRAN ALLANGVELR DNQLVVPSEG LYLIYSQVLF KGQGCPSTHV LLTHTISRIA VSYQTKVNLL SAIKSPCQRE TPEGAEAKPW YEPIYLGGVF QLEKGDRLSA EINRPDYLDF AESGQVYFGI IAL //

Structure databases

Protein Data Bank (PDB)

Protein Data Bank - http://www.rcsb.org/pdb

Diffraction 7373 structures determined by X-ray diffractionNMR 388 structures determined by NMR spectroscopyTheoretical Model 201 structures proposed by modeling

PDB

PDB

PDB

PDB

Visualizing Structures

Cn3D versie 4.0 (NCBI)

Les 1

• Bioinformatics I Revisited in 5 slides• Why bother making databases ?• DataBases

– FF• *.txt• Indexed version

– Relational (RDBMS)• Access, MySQL, PostGRES, Oracle

– OO (OODBMS)• AceDB, ObjectStore

– Hierarchical• XML

– Frame based system • Eg. DAML+OIL

– Hybrid systems

Problems with Flat files …

• Wasted storage space• Wasted processing time• Data control problems• Problems caused by changes to data

structures • Access to data difficult• Data out of date• Constraints are system based• Limited querying eg. all single exon

GPCRs (<1000 bp)

• What is a relational database ?– Sets of tables and links (the data)– A language to query the datanase (Structured

Query Language)– A program to manage the data (RDBMS)

• Flat files are not relational– Data type (attribute) is part of the data– Record order mateters– Multiline records– Massive duplication

• Bv Organism: Homo sapeinsm Eukaryota, …– Some records are hierarchical

• Xrefs– Records contain multiple “sub-records”– Implecit “Key”

• records• fields• linear file of

homogeneous records

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

name.........................surname....................phone........................address......................

• Terms and concepts:– tuple

– domain

– attribute

– key

– integrity rules

Introduction to Database Systems

• Historic Background– Hierarchical databases (IMS) - IBM 1968

• Hierarchical structures between file records

– Network databases - CODASYL Group 1969• Network structures of record types

• Linked chains between 'Owner' and 'Member' records

• Included in Cobol, procedural language - Manual navigation

– Relational Data Model - E. F. Codd 1970• Mathematical foundation of databases

• New non-procedural language SQL - Automatic navigation

– Object-relational databases

– Object-oriented databases

Relational

• The Relational model is not only very mature, but it has developed a strong knowledge on how to make a relational back-end fast and reliable, and how to exploit different technologies such as massive SMP, Optical jukeboxes, clustering and etc. Object databases are nowhere near to this, and I do not expect then to get there in the short or medium term.

• Relational Databases have a very well-known and proven underlying mathematical theory, a simple one (the set theory) that makes possible – automatic cost-based query optimization,

– schema generation from high-level models and

– many other features that are now vital for mission-critical Information Systems development and operations.

The Benefits of Databases

• Redundancy can be reduced

• Inconsistency can be avoided

• Conflicting requirements can be balanced

• Standards can be enforced

• Data can be shared

• Data independence

• Integrity can be maintained

• Security restrictions can be applied

Relational Terminology

IDID NAMENAME PHONEPHONE EMP_IDEMP_ID

201201 UnisportsUnisports 55-2066101 1255-2066101 12

202202 Simms AtheleticsSimms Atheletics 81-20101 1481-20101 14

203203 Delhi SportsDelhi Sports 91-10351 1491-10351 14

204204 WomansportWomansport 1-206-104-0103 111-206-104-0103 11

Row (Tuple)

Column (Attribute)

CUSTOMER Table (Relation)

Relational Database Terminology

• Each row of data in a table is uniquely identified by a primary key (PK)• Information in multiple tables can be logically related by foreign keys (FK)

IDID LAST_NAMELAST_NAME FIRST_NAMEFIRST_NAME

1010 HavelHavel MartaMarta1111 MageeMagee ColinColin1212 GiljumGiljum HenryHenry1414 NguyenNguyen MaiMai

IDID NAMENAME PHONEPHONE EMP_IDEMP_ID

201201 UnisportsUnisports 55-2066101 1255-2066101 12202202 Simms AtheleticsSimms Atheletics 81-20101 1481-20101 14203203 Delhi SportsDelhi Sports 91-10351 1491-10351 14204204 WomansportWomansport 1-206-104-0103 111-206-104-0103 11

Table Name: CUSTOMER Table Name: EMP

Primary Key Foreign Key Primary Key

Relational Database Terminology

Relational operators

• Relational– select

rel WHERE boolean-xpr

– projectrel [ attr-specs ]

– joinrel JOIN rel

– divide byrel DIVIDEBY rel

• Set-based

rel UNION rel

rel INTERSECT rel

\rel MINUS rel

rel TIMES rel

Disadvantages

• size

• complexity

• cost

• Additional hardware costs

• Higher impact of failure

• Recovery more difficult

• RDBM products– Free

• MySQL, very fast, widely usedm easy to jump into but limited non standard SQL

• PostrgreSQL – full SQLm limited OO, higher learning curve than MySQL

– Commercial• MS Access – Great query builder, GUI

interfaces• MS SQL Server – full SQL, NT only• Oracle, everything, including the kitchen

sink• IBM DB2, Sybase

Example 3-tier model in biological database

http://www.bioinformatics.beExample of different interface to the same back-end database (MySQL)

What is the Internet?

• A network of networks• Based on TCP/IP (Transmission Control Protocol/Internet Protocol)• Global• A variety of services and tools

What is the World Wide Web?

The Web presents information as a series of "documents," often referred to as web pages, that are prepared using the Hypertext Markup Language (HTML).

Using HTML, the document's author can specially code sections of the document to "point" to other information resources. These specially coded sections are referred to as hypertext links.

Users viewing the webpage can select the hypertext link and retrieve or connect to the information resource that the link points to.

What is HTTP?

In Summary:

HTTP is an acronym for Hypertext Transfer Protocol. HTTP is the set of rules, or protocol, that enables hypertext data to be transferred from one computer to another, and is based on the client/server principle.

Hypertext is text that is coded using the Hypertext Markup Language. These codes and HTTP work together to link resources to each other. HTTP enables users to retrieve a wide variety of resources such as text, graphics, sound, animation and other hypertext documents, and allows hypertext access to other Internet protocols.

What is HTML?

• Standardized codes

• Web pages

• SGML

• Descriptive markup

• Tags

What is HTML?

HTML stands for Hypertext Markup Language. HTML consists of standardized codes, or "tags", that are used to define the structure of information on a web page. HTML is used to prepare documents for the World Wide Web. A web page is single a unit of information, often called a document, that is available on the World Wide Web.

HTML defines several aspects of a web page including heading levels, bold, italics, images, paragraph breaks and hypertext links to other resources.

What is HTML?

HTML is a sub-language of SGML, or Standard Generalized Markup Language. SGML is a system that defines and standardizes the structure of documents.

Both SGML and HTML utilize descriptive markup to define the structure of an area of text. In general terms, descriptive markup does not specify a particular font or point size for an area of text. Instead, it describes an area of text as a heading or a caption, for example.

Therefore, in HTML, text is marked as a heading, subheading, numbered list, bold, italic, etc.

What is a URL?

URLs consist of letters, numbers, and punctuation.

The basic structure of a URL is hierarchical, and the hierarchy moves from left to right:

Examples:

http://www.healthyway.com:8080/exercise/mtbike.htmlgopher://gopher.state.edu/ftp://ftp.company.com/

protocol://server-name.domain-name.top-level domain:port/directory/filename

What is an IP Address?

• A way to identify machines on the Internet

• A number

• Unique

• Global

• Standardized

What is an IP Address?

If you want to connect to another computer, transfer files to or from another computer, or send an e-mail message, you first need to know where the other computer is - you need the computer's "address."

An IP (Internet Protocol) address is an identifier for a particular machine on a particular network; it is part of a scheme to identify computers on the Internet.

IP addresses are also referred to as IP numbers and Internet addresses. An IP address consists of four sections separated by periods.

Each section contains a number ranging from 0 to 255. Example = 198.41.0.52

What is an IP Address?

The diagram below compares Class A, Class B and Class C IP addresses. The blue numbers represent the network and the red numbers represent hosts on the network. Therefore, a Class A network can support many more hosts than a Class C network.

What is Internet Addressing?

Most computers on the Internet have a unique domain name.

Special computers, called domain name servers, look up the domain name and match it to the corresponding IP address so that data can be properly routed to its destination on the Internet.

An example domain name is: healthyway.com

Domain names are easier formost people to relate to thana numeric IP address.

healthyway.com

111.23.125.68

What is Internet Addressing?

URL stands for Uniform Resource Locator. URLs are used to identify specific sites and files available on the World Wide Web.

The structure of a URL is:

protocol://server.subdomain.top-level-domain/directory/filename

Not all URLs will have the directory and filename.

Two examples: http://www.healthyway.com/exercise/mtbike.html gopher://gopher.state.edu/

What is TCP/IP?

• A suite of protocols

• Rules for sending and receiving data across

• Networks

• Addressing

• Management and verification

What is TCP/IP?

TCP/IP stands for Transmission Control Protocol/Internet Protocol.

TCP/IP is actually a collection of protocols, or rules, that govern the way data travels from one machine to another across networks.

The Internet is based on TCP/IP.

What is TCP/IP?

TCP/IP has two major components: TCP and IP.

IP:

envelopes and addresses the data

enables the network to read the envelope and forward the data to its destination

defines how much data can fit in a single "envelope" (a packet)

What is TCP/IP?

The relationship between data, IP, and networks is often compared to the relationship between a letter, its addressed envelope, and the postal system.

What is TCP/IP?

TCP:

breaks data up into packets that the network can handle efficiently

verifies that all the packets arrive at their destination

"reassembles" the data

TCP/IP can be compared to moving across country.

What is a packet?

• Unit of information

• Data

• Header Information

• Routers

• TCP/IP

What is a packet?

A packet is a single unit, or "package", of data that is sent across a network. Data is broken into packets before it is sent across the Internet. Types of data that are sent across the Internet using packets include:

E-mail messages

Files, via File Transfer Protocol (FTP)

Web pages, via the World Wide Web (WWW)

What is a packet?

In addition to the actual data, packets also contain header information.

The header of a packet contains both the originating and destination IP (Internet Protocol) address. The header also contains coding to handle transmission errors and keep packets flowing.

Header information can be compared to addressing an envelope. Like the header of a packet, an envelope contains the addresses of both the sender and the recipient, in order to keep track of who the envelope is from and who it is going to.

What is a packet?

Header information is used by routers to send packets across a network. Routers are computers that are dedicated to "reading" header information and determining which router to send the packet to next. Packets move from router to router until they reach their final destination, in much the same way that an envelope travels between postal substations before reaching the recipient.

The packets that make up data, such as an e-mail message or a web page, will not necessarily all follow the same route to the final destination. The route that a packet travels depends on many variables, including network traffic at that particular moment and the size of the packet being sent.

What is a packet?

Transmission Control Protocol/Internet Protocol (TCP/IP) is a set of rules that govern how data is transmitted across networks and the Internet.

TCP/IP utilizes packets to send information across the Internet. TCP and IP have different functions related to packets.

What is a packet?

TCP completes the following:

Sends the packets in sequence, so they arrive at their destination in the correct order.

Ensures the integrity of packets. If a packet has been damaged, TCP will request that the damaged packet be resent.

What is a packet?

IP completes the following:

Breaks the data into packets.

Places header information into the packet, enabling the packet to be forwarded from router to router until it reaches the final destination.

Determines how much data can fit into a single packet.

What is a packet?

The following diagram illustrates an e-mail message being sent across a network.

1. Data that makes up an e-mail message is split into packets by the IP portion of TCP/IP. IP also adds header information to each packet.

2. Using header information in the packets, routers determine the best path for each packet to take to its final destination.

3. The TCP portion of TCP/IP reassembles the packets in the correct order and ensures that all packets have arrived undamaged.

1 2 3

4 5 6

1 2 3

4 5 6

Data that makesup entire e-mail

mesasage

Data that makesup entire e-mail

mesasage

1

ROUTER

4

ROUTER

ROUTER

ROUTER

ROUTER

11

2

2

3

45

5

6

STEP 1

STEP 2

STEP 3

Message being sent Message is received

4

3

6

Message is sent

What is Telnet?

Telnet is a protocol, or set of rules, that enables one computer to connect to another computer. This process is also referred to as remote login.

The user's computer, which initiates the connection, is referred to as the local computer, and the machine being connected to, which accepts the connection, is referred to as the remote, or host, computer.

The remote computer can be physically located in the next room, the next town, or in another country.

What is Telnet?

Once connected, the user's computer emulates the remote computer. When the user types in commands, they are executed on the remote computer. The user's monitor displays what is taking place on the remote computer during the telnet session.

Local ComputerRemote Computer

Welcome toXYZ

UniversityLibrary

Welcome toXYZ

UniversityLibrary

The procedure for connecting to a remote computer will depend on how your Internet access is set-up.

What is Telnet?

Once a connection to a remote computer is made, instructions or menus may appear. Some remote machines may require a user to have an account on the machine, and may prompt users for a username and password.

Many resources, such as library catalogs, are available via telnet without an account and password.

WorldWindow Washington University, St. Louis, MO07/30/96 09:25___________________________________________________

Welcome to WorldWindow, the WU Libraries'Electronic Information Gateway! Some services areonly available to authorized users and require thatyou log in with a username and password. If you donot have a username and password, just press RETURNand you will receive access to all public services.

Username [ ] Password [ ]

Here is an example taken from a telnet session to Washington University in St. Louis, MO:

SSH Features

• Command line terminal connection tool

• Replacement for rsh, rcp, telnet, and others

• All traffic encrypted• Both ends authenticate themselves to

the other end• Ability to carry and encrypt non-

terminal traffic

Brief History

• SSH.com’s SSH1, originally completely free with source code, then license changed with version 1.2.13

• SSH.com’s SSH2, originally only commercial, but now free for some uses.

• OpenSSH team took the last free SSH1 release, refixed bugs, added features, and added support for the SSH2 protocol.

SSH key background

• Old way: password stored on server, user supplied password compared to stored version

• New way: private key kept on client, public key stored on server.

What is FTP?

• Protocol

• File transfer

• Client/Server based

• Anonymous FTP

• File types

• Compression

What is FTP?

FTP stands for File Transfer Protocol, and is part of the TCP/IP protocol suite. It is the protocol, or set of rules, which enables files to be transferred between computers.

FTP is a powerful tool which allows files to be transferred from “computer A” to “computer B”, or vice versa.

A B

FTP from "A" to "B"

or from "B" to "A"

What is FTP?

FTP works on the client/server principle. A client program enables the user to interact with a server in order to access information and services on the server computer.

Files that can be transferred are stored on special computers called FTP servers. To access these files, an FTP client program is used. This is an interface that allows the user to locate the file(s) to be transferred and initiate the transfer process.

What is FTP?

The basic steps to use FTP are:

• Connect to the FTP server

• Navigate the file structure to find the file you want

• Transfer the file

The specifics of each step will vary, depending on the client program being used and the type of Internet connection.

What is FTP?

Anonymous FTP

Anonymous FTP allows a user to access a wealth of publicly available information. No special account or password is needed.

However, an anonymous FTP site will sometimes ask that users login with the name “anonymous” and use their e-mail address as the password.

% ftp ftp.sura.netConnected to services.sura.net.220 services.sura.net FTP server (Version wu-2.4(1) ThuJul 13 16:30:50 EDT 1995) ready.Name (ftp.sura.net:annac): anonymous331 Guest login ok, send your complete e-mail addressas password.Password:***********

Login Name

Password

What is FTP?

There is a wide variety of files that are publicly available through anonymous FTP:

• Shareware - software that you can use free for a trial period but then pay a fee for• Freeware - completely free software, for example fonts, clipart and games• Upgrades & Patches - upgrades to current software and “fixes” for software problems• Documents - examples include research papers, articles and Internet documentation

What is FTP?

Files on FTP servers are often compressed. Compression decreases file size. This enables more files to be stored on the server and makes file transfer times shorter. In order to use a compressed file it needs to be decompressed using appropriate software.

It is a good idea to have current virus checking software on the computer before files are downloaded to it.

BioSQL

Conclusions

• A database is a central component of any contemporary information system

• The operations on the database and the mainenance of database consistency is handled by a DBMS

• There exist stand alone query languages or embedded languages but both deal with definition (DDL) and manipulation (DML) aspects

• The structural properties, constraints and operations permitted within a DBMS are defined by a data model - hierarchical, network, relational

• Recovery and concurrency control are essential

• Linking of heterogebous datasources is central theme in modern bioinformatics