Realtor Database: Data Redundancy and AnomaliesConduct an in-depth examination and analysis of the database,Week1_Realtor.mdb(Download Here). Apply the concepts of database systems that you have learned this week.For example, you may want to include a definition and analysis of these concepts:Describe the data contained in the database.Describe the tables, fields, and records in the database.Describe the keys, indexes, and relationships in the database.Identify data redundancy and describe potential solutions.Identify data anomalies and describe potential solutions.Identify fields containing more than one item of data and describe potential solutions.Identify other design concerns and describe potential solutions.The document should be written in Microsoft Word. The format should be APA style, double-spaced, and sufficient length to thoroughly complete the assignment (usually 2-3 pages). Be sure to cite your sources. Your final submission will be a Microsoft Word document.

Objective of Competition: You will be implementing stock market future prediction system through multi-stage processing of the stock market data. At the end of each stage, you will process raw time-series data using either ML algorithm or use some preprocessing filters. I have provided you with 20 years worth of daily data for 20 ticker symbols. You will use them for training and testing each stage of the algorithms. Step 1: Clustering (Completed in assignment 3) - COMPLETED  In this step, you will cluster the candles (Open, High, Low, Close, Volume(optional)) of daily data in n clusters. Here is numbers of clusters will be chosen by you. You shall provide justification for choice. of number of clusters. Cluster validity shall be used to ensure that the clusters built by your method are good. You are free to choose one or more clustering algorithms and pick results of one that provides you the best cluster validity. Step 2: Cluster labeling ( To be completed) You may visually inspect each cluster to perform this step. Use the cluster center and variance to create an orderly label for each cluster that range from (-k to +k) . In this case, total numbers of clusters you will have are (n = 2k+1). Because there are negative and positive candles, your order will represent relative size of candle in each direction. In above example, I am assuming symmetric distribution of positive and negative candles. However, you may have asymmetric distribution. Use the cluster label to represent each candle and generate a new file which has "Date" and respective "Cluster Label" replacing OHLC data.  Step 3: Create trends using zigzag indicator: Download zigzag.ipynb (attached below).This will help you calculate long term trend in price data. The zigzag method expects to have OHLC pandas data frame object and returns same object with additional column called 'trend'. The value +1 represents up trend while -1 represents down trend. You can run program and understand how it works. The plot function will help you visualize those long term trend. For this assignment, you will calculate 10% trend value, which you can pass as a parameter to zigzag function (pct=10.0). Generated trend values are now your labels for classification step. Step 4: Create model that can predict trend Now you have daily data with its trend value. In this step, you will divide all 30 stocks for training your model to predict the trend. Each daily sample is now represented as "Cluster label" and output as "trend". However system will not train better unless you give past n days cluster label as input vector and predict 'trend" of n+1 day as output. Ensure. that the day for which you are predicting trend is not included in past n day cluster label input feature vector. For each of the 30 stocks, you will generate your experimental data set using described method in prior paragraph. Now combine all 30 stocks data and generate a large dataset for training.  Step 5: Train and Test your model  You will perform n fold validation to validate consistency of your model. I suggest using n = 7. At the end of your experiment, generate your confusion matrix representing accuracies with mean and its std deviation. At this point, I will provide you a new ticker symbol to test goodness of your model. The accuracy of this file shall be printed on output after your program calculates the confusion matrix.

Project 1: Capture the Flag (CTF) Write-UpThe individual CTF challenge is made up of 100 challenges separated into 10 categories of 10 challenges. You may choose which challenges you want to attempt and may attempt multiple challenges from the same category. Once you have attempted any of the 10 questions out of the 100, proceed to the CTF Challenge Write-Up. For this Project:Review the Capture the Flag (CTF) Challenges and pick 10 to solve.You can check your answers with the “CTF Answer Checker” in the quizzes section of the courseYou can keep submitting your CTF answers until you get 10 correctThis will not affect your assignment or course gradeWhen you have attempted 10 challenges:Follow the instructions in the Capture the Flag (CTF) Write-Up Template to answer follow-up questions on your CTF experienceFor the Write-Up, you should list the 10 challenges you attempted and explain at least 2 challenges that you actually solved to complete the assignmentYou do not need 10 "correct" solves; rather, focus on what you learned from the challenge(s) you solved and also those you did not solveHow Will My Work Be Evaluated?A cybersecurity CTF (Capture the Flag) is a competition that tests your ability to apply skills that you have learned in this and other related courses to solve cybersecurity problems. These competitions will allow you to demonstrate your ability to apply your skills and knowledge to real-world problems that you will encounter in your tasks as a cyber analyst.Employers encourage CTF participation because it will help employees improve their analytical skills. Companies often use these competitions as recruitment events for cyber talent. The ability to solve these types of cyber challenges will directly translate to the ability to perform well on the job. During an interview, you can mention that you have participated in an individual CTF within this course.The solutions to the CTF questions represent just one aspect of how you will be evaluated. Your written submission, which will discuss the problems solved and the strategies you used to solve them, will not only allow you to present clear ideas and conclusions but will also allow you to reflect on those approaches so that when you are confronted with similar situations in the workplace, you will be able to respond with the benefit of your experience.The following evaluation criteria aligned to the competencies will be used to grade your assignment:1.1.3: Present ideas in a clear, logical order appropriate to the task.2.1.1: Identify the issue or problem under consideration.2.3.1: State conclusions or solutions clearly and precisely.10.1.1: Identify the problem to be solved.12.2.3: Determine the appropriate system category.13.1.1: Create documentation appropriate to the stakeholder.